Jul 21 12:49:01.639116 ip-10-0-140-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 12:49:01.639131 ip-10-0-140-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 12:49:01.639140 ip-10-0-140-67 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 12:49:01.639452 ip-10-0-140-67 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 12:49:11.132261 ip-10-0-140-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 12:49:11.132277 ip-10-0-140-67 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7d8629c2605345b4bc638de8b0857313 --
Jul 21 12:50:54.852440 ip-10-0-140-67 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 12:50:55.180459 ip-10-0-140-67 kubenswrapper[2532]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:50:55.180459 ip-10-0-140-67 kubenswrapper[2532]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 12:50:55.180459 ip-10-0-140-67 kubenswrapper[2532]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:50:55.180459 ip-10-0-140-67 kubenswrapper[2532]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 12:50:55.180459 ip-10-0-140-67 kubenswrapper[2532]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 12:50:55.182364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.182285    2532 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 12:50:55.186892 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186815    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.186892 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186892    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.186892 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186897    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.186892 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186902    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.187096 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186906    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.187096 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186910    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.187096 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.186913    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.187221 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187047    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187223    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187227    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187231    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187234    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187237    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187240    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187245    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187247    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187250    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187253    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187256    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187259    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187261    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.187257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187264    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187267    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187270    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187272    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187275    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187277    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187280    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187282    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187285    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187288    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187290    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187293    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187295    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187298    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187300    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187303    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187305    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187309    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187311    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187314    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.187630 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187316    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187319    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187322    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187325    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187327    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187330    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187333    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187335    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187338    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187340    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187342    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187345    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187348    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187350    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187354    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187356    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187359    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187362    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187365    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187367    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.188107 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187373    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187375    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187378    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187381    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187383    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187387    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187390    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187393    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187396    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187399    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187401    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187404    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187406    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187410    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187412    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187417    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187420    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187423    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187425    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187428    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.188609 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187430    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187433    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187437    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187440    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187442    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187445    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187448    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187452    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187456    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187459    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187462    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187465    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187468    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187471    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187475    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187479    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187482    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.187485    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188927    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.189133 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188935    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188939    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188942    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188945    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188947    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188950    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188953    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188955    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188958    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188960    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188963    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188965    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188967    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188970    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188972    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188975    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188978    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188980    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188983    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188986    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.189611 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188989    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188991    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188993    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188996    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.188998    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189000    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189003    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189005    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189007    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189010    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189013    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189015    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189018    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189021    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189023    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189025    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189028    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189030    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189032    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189034    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.190100 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189037    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189039    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189041    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189044    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189048    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189051    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189054    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189058    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189061    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189064    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189067    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189071    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189075    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189078    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189081    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189083    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189086    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189088    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189091    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.190599 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189093    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189095    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189098    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189100    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189102    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189105    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189108    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189110    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189112    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189115    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189118    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189120    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189123    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189125    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189128    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189130    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189133    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189135    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189138    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189141    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.191058 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189144    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189146    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189166    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189170    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189175    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189179    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189182    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189184    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189187    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189189    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189192    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189194    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189197    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189199    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189201    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189204    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189206    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189210    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189213    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.191581 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189591    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189597    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189600    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189603    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189606    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189609    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189612    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189614    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189617    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189620    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189622    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189625    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189629    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189632    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189635    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189639    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189643    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189647    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189650    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.192036 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189653    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189655    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189658    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189660    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189663    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189666    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189668    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189670    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189673    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189676    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189678    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189680    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189683    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189685    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189688    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189691    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189693    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189696    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189699    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189701    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.192507 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189703    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189706    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189708    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189711    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189713    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189715    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189718    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189720    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189722    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189725    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189731    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189734    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189736    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189739    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189741    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189743    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189746    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189750    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189753    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.193007 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189756    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189759    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189762    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189765    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189768    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189770    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189773    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189775    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189778    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189781    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189783    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189786    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189788    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189790    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189792    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189796    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189798    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189801    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189803    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.193473 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189806    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189808    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189810    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189812    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189816    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189819    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189822    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189825    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189827    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189829    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189832    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189835    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189837    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189839    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189842    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189845    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189847    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189849    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189852    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189854    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.194378 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189856    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.189859    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189928    2532 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189935    2532 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189940    2532 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189945    2532 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189949    2532 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189951    2532 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189956    2532 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189960    2532 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189963    2532 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189965    2532 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189969    2532 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189972    2532 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189975    2532 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189978    2532 flags.go:64] FLAG: --cgroup-root=""
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189981    2532 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189984    2532 flags.go:64] FLAG: --client-ca-file=""
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189988    2532 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189991    2532 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189995    2532 flags.go:64] FLAG: --cluster-domain=""
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.189998    2532 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190001    2532 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190004    2532 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 12:50:55.195189 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190007    2532 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190010    2532 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190013    2532 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190017    2532 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190020    2532 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190023    2532 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190026    2532 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190029    2532 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190031    2532 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190034    2532 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190038    2532 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190041    2532 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190043    2532 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190046    2532 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190049    2532 flags.go:64] FLAG: --enable-server="true"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190051    2532 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190055    2532 flags.go:64] FLAG: --event-burst="100"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190058    2532 flags.go:64] FLAG: --event-qps="50"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190061    2532 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190063    2532 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190066    2532 flags.go:64] FLAG: --eviction-hard=""
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190070    2532 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190072    2532 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190075    2532 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190079    2532 flags.go:64] FLAG: --eviction-soft=""
Jul 21 12:50:55.196138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190082    2532 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190084    2532 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190088    2532 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190091    2532 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190093    2532 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190096    2532 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190099    2532 flags.go:64] FLAG: --feature-gates=""
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190102    2532 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190105    2532 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190108    2532 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190111    2532 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190114    2532 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190117    2532 flags.go:64] FLAG: --help="false"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190120    2532 flags.go:64] FLAG: --hostname-override="ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190123    2532 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190126    2532 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190128    2532 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190131    2532 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190134    2532 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190137    2532 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190139    2532 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190142    2532 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190145    2532 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 12:50:55.197100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190164    2532 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190169    2532 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190171    2532 flags.go:64] FLAG: --kube-reserved=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190174    2532 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190177    2532 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190179    2532 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190184    2532 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190186    2532 flags.go:64] FLAG: --lock-file=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190190    2532 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190193    2532 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190197    2532 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190202    2532 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190205    2532 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190208    2532 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190211    2532 flags.go:64] FLAG: --logging-format="text"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190214    2532 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190217    2532 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190219    2532 flags.go:64] FLAG: --manifest-url=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190222    2532 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190226    2532 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190229    2532 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190233    2532 flags.go:64] FLAG: --max-pods="110"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190235    2532 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190238    2532 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190241    2532 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 12:50:55.198103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190243    2532 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190246    2532 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190249    2532 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190251    2532 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190258    2532 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190261    2532 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190264    2532 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190266    2532 flags.go:64] FLAG: --pod-cidr=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190269    2532 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190274    2532 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190277    2532 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190279    2532 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190282    2532 flags.go:64] FLAG: --port="10250"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190286    2532 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190289    2532 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d2062a4ede38ac9"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190292    2532 flags.go:64] FLAG: --qos-reserved=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190296    2532 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190299    2532 flags.go:64] FLAG: --register-node="true"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190302    2532 flags.go:64] FLAG: --register-with-taints=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190305    2532 flags.go:64] FLAG: --registry-burst="10"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190309    2532 flags.go:64] FLAG: --registry-qps="5"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190311    2532 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190314    2532 flags.go:64] FLAG: --reserved-memory=""
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190317    2532 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190320    2532 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 12:50:55.199188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190323    2532 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190326    2532 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190328    2532 flags.go:64] FLAG: --runonce="false"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190331    2532 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190334    2532 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190336    2532 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190339    2532 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190341    2532 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190344    2532 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190347    2532 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190350    2532 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190352    2532 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190355    2532 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190357    2532 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190360    2532 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190362    2532 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190365    2532 flags.go:64] FLAG: --system-cgroups=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190367    2532 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190372    2532 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190375    2532 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190378    2532 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190383    2532 flags.go:64] FLAG: --tls-min-version=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190385    2532 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190390    2532 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190392    2532 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 12:50:55.199834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190395    2532 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190398    2532 flags.go:64] FLAG: --v="2"
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190401    2532 flags.go:64] FLAG: --version="false"
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190406    2532 flags.go:64] FLAG: --vmodule=""
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190410    2532 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190413    2532 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190526    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190530    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190533    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190536    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190539    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190542    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190545    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190547    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190550    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190552    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190554    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190557    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190559    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190562    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190564    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.200936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190566    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190569    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190572    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190574    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190577    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190579    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190583    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190586    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190589    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190593    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190595    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190599    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190602    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190605    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190608    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190611    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190614    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190617    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190619    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190621    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.201765 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190624    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190626    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190629    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190632    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190634    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190636    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190639    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190641    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190644    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190646    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190648    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190651    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190653    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190655    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190658    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190660    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190662    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190665    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190670    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190673    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.202588 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190676    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190681    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190684    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190687    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190690    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190693    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190695    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190698    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190701    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190703    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190706    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190709    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190711    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190713    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190716    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190718    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190720    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190722    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190725    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.203459 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190727    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190729    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190732    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190734    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190736    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190739    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190741    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190743    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190746    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190748    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190751    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190755    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190757    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190759    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190762    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190764    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190767    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190770    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190772    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190774    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.203936 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190777    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190779    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190782    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190784    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.190787    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.190792    2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.199111    2532 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.199131    2532 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.199817    2532 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.199831    2532 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199918    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199927    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199932    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199937    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199941    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.204610 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199945    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199950    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199954    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199958    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199963    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199970    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199975    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199980    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199985    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199990    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.199995    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200000    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200005    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200010    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200015    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200019    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200024    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200029    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200033    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.205013 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200040    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200045    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200050    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200054    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200058    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200063    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200067    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200071    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200076    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200080    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200084    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200088    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200093    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200096    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200101    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200105    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200109    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200113    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200117    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200121    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200125    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.205573 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200129    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200135    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200139    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200142    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200146    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200170    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200176    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200180    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200184    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200191    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200197    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200201    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200210    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200215    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200219    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200224    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200230    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200235    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200240    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.206119 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200245    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200249    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200253    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200258    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200261    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200266    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200270    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200275    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200279    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200283    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200288    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200292    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200296    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200300    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200304    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200308    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200314    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200318    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200322    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200326    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.206643 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200330    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200334    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200338    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200342    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200347    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200351    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200358    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200364    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200368    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200374    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200378    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200382    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200386    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200391    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.207183 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200395    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.200404    2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200655    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200663    2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200668    2532 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200672    2532 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200677    2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200682    2532 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200686    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200690    2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200695    2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200699    2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200703    2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200707    2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200712    2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 12:50:55.207688 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200718    2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200725    2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200730    2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200734    2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200739    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200743    2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200747    2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200751    2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200755    2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200760    2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200765    2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200769    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200774    2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200778    2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200782    2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200787    2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200791    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200798    2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200803    2532 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 12:50:55.208331 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200808    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200812    2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200816    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200822    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200826    2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200831    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200835    2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200839    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200843    2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200848    2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200852    2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200856    2532 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200860    2532 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200865    2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200869    2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200873    2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200877    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200882    2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200886    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200890    2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 12:50:55.209109 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200893    2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200897    2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200901    2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200906    2532 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200910    2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200915    2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200919    2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200923    2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200927    2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200931    2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200935    2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200939    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200943    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200946    2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200950    2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200954    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200960    2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200966    2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200971    2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 12:50:55.209621 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200977    2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200981    2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200986    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200991    2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.200995    2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201000    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201004    2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201008    2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201012    2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201017    2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201021    2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201025    2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201030    2532 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201034    2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201038    2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201042    2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201047    2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201051    2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201055    2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201060    2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 12:50:55.210146 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201064    2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201068    2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201073    2532 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201077    2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201081    2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201085    2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201089    2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:55.201093    2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.201101    2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.201285    2532 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.203993    2532 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.205247    2532 server.go:1019] "Starting client certificate rotation"
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.205351    2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 12:50:55.210900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.205389    2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 12:50:55.211388 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.208094    2532 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 12:50:55.211388 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.211266    2532 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 12:50:55.218968 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.218952    2532 log.go:25] "Validated CRI v1 runtime API"
Jul 21 12:50:55.220861 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.220848    2532 log.go:25] "Validated CRI v1 image API"
Jul 21 12:50:55.221618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.221594    2532 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 12:50:55.223748 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.223724    2532 fs.go:135] Filesystem UUIDs: map[0ca3fde6-abeb-4a3a-9d57-1909130f102a:/dev/nvme0n1p4 6d0917f7-4ffe-4c93-956c-a5848fd04cae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 21 12:50:55.223818 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.223748    2532 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 12:50:55.229556 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.229443    2532 manager.go:216] Machine: {Timestamp:2026-07-21 12:50:55.228332996 +0000 UTC m=+0.265363061 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101755 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f910bf128b929bb3b70212177b02b SystemUUID:ec2f910b-f128-b929-bb3b-70212177b02b BootID:7d8629c2-6053-45b4-bc63-8de8b0857313 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:3f:51:68:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:3f:51:68:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:74:91:47:54:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 12:50:55.229556 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.229549    2532 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 12:50:55.229662 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.229648    2532 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 12:50:55.231733 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.231712    2532 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 12:50:55.231874 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.231736    2532 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 12:50:55.232800 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.232786    2532 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 12:50:55.232834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.232805    2532 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 12:50:55.232834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.232812    2532 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 12:50:55.233353 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.233342    2532 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 12:50:55.234559 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.234548    2532 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 12:50:55.235708 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.235694    2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 12:50:55.238224 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238212    2532 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 12:50:55.238341 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238332    2532 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 12:50:55.238386 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238378    2532 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 12:50:55.238414 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238397    2532 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 12:50:55.238441 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238417    2532 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 12:50:55.238441 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238430    2532 kubelet.go:398] "Adding apiserver pod source"
Jul 21 12:50:55.238506 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238442    2532 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 12:50:55.238824 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238804    2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 12:50:55.238931 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.238831    2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 12:50:55.240644 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.240616    2532 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 12:50:55.242424 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.242410    2532 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 12:50:55.242478 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.242441    2532 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 12:50:55.243696 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243679    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 12:50:55.243696 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243695    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 12:50:55.243696 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243700    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243706    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243714    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243720    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243728    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243734    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243740    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243746    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243754    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 12:50:55.243884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.243759    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 12:50:55.244776 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.244766    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 12:50:55.244776 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.244775    2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 12:50:55.247993 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.247979    2532 server.go:1268] "Started kubelet"
Jul 21 12:50:55.251053 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.248045    2532 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 12:50:55.251458 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.251424    2532 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 12:50:55.251797 ip-10-0-140-67 systemd[1]: Started Kubernetes Kubelet.
Jul 21 12:50:55.252483 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.251861    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 12:50:55.252483 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.251921    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 12:50:55.252483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.251911    2532 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 12:50:55.252483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.251981    2532 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 12:50:55.253596 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.253578    2532 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 12:50:55.254627 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.254608    2532 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 12:50:55.256634 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.256616    2532 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 12:50:55.258053 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.257182    2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c44f09a8a077ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-21 12:50:55.247947754 +0000 UTC m=+0.284977819,LastTimestamp:2026-07-21 12:50:55.247947754 +0000 UTC m=+0.284977819,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 21 12:50:55.259724 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.259704    2532 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 12:50:55.259724 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.259710    2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 12:50:55.259832 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.259821    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.260323 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260305    2532 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 12:50:55.260415 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260403    2532 factory.go:55] Registering systemd factory
Jul 21 12:50:55.260415 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260420    2532 factory.go:223] Registration of the systemd container factory successfully
Jul 21 12:50:55.260547 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260464    2532 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 12:50:55.260547 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260478    2532 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 12:50:55.260643 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260615    2532 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 12:50:55.260643 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260623    2532 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 12:50:55.260704 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260647    2532 factory.go:153] Registering CRI-O factory
Jul 21 12:50:55.260704 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260661    2532 factory.go:223] Registration of the crio container factory successfully
Jul 21 12:50:55.260786 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260709    2532 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 12:50:55.260786 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260735    2532 factory.go:103] Registering Raw factory
Jul 21 12:50:55.260786 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.260752    2532 manager.go:1196] Started watching for new ooms in manager
Jul 21 12:50:55.261143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.261132    2532 manager.go:349] Starting recovery of all containers
Jul 21 12:50:55.270641 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.264945    2532 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 12:50:55.270641 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.264985    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 12:50:55.271093 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.270955    2532 manager.go:354] Recovery completed
Jul 21 12:50:55.275528 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.275515    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.277310 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277288    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.277361 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277327    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.277361 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277341    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.277853 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277841    2532 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 12:50:55.277889 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277853    2532 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 12:50:55.277889 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277864    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.277889 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.277868    2532 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 12:50:55.278877 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.278854    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.278958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.278946    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.279011 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.278974    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.280103 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.280008    2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c44f09aa6085b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-21 12:50:55.277311416 +0000 UTC m=+0.314341484,LastTimestamp:2026-07-21 12:50:55.277311416 +0000 UTC m=+0.314341484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 21 12:50:55.280365 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.280342    2532 policy_none.go:49] "None policy: Start"
Jul 21 12:50:55.280419 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.280371    2532 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 12:50:55.280419 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.280389    2532 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 12:50:55.282465 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.282451    2532 policy_none.go:47] "Start"
Jul 21 12:50:55.288620 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.288596    2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qplt6"
Jul 21 12:50:55.291093 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.291020    2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c44f09aa60e088  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-21 12:50:55.277334664 +0000 UTC m=+0.314364731,LastTimestamp:2026-07-21 12:50:55.277334664 +0000 UTC m=+0.314364731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 21 12:50:55.294609 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.294591    2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qplt6"
Jul 21 12:50:55.315747 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.315729    2532 manager.go:337] "Starting Device Plugin manager"
Jul 21 12:50:55.315833 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.315764    2532 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 12:50:55.315833 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.315778    2532 server.go:87] "Starting device plugin registration server"
Jul 21 12:50:55.316061 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.316041    2532 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 12:50:55.316185 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.316054    2532 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 12:50:55.316255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.316189    2532 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 12:50:55.316333 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.316314    2532 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 12:50:55.316333 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.316326    2532 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 12:50:55.316824 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.316801    2532 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 12:50:55.316905 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.316848    2532 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.350209 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.350180    2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 12:50:55.359206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.351482    2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 12:50:55.359206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.351522    2532 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 12:50:55.359206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.351544    2532 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 12:50:55.359206 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.351574    2532 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 12:50:55.359206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.354068    2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:50:55.416338 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.416305    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.417263 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.417241    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.417364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.417279    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.417364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.417292    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.417364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.417324    2532 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.426366 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.426346    2532 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.426438 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.426369    2532 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-67.ec2.internal\": node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.448695 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.448673    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.451658 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.451641    2532 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"]
Jul 21 12:50:55.451714 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.451701    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.452491 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.452475    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.452570 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.452508    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.452570 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.452530    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.454964 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.454950    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.455095 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.455080    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.455169 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.455117    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.455623 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.455608    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.455700 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.455637    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.455700 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.455651    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.456211 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.456193    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.456299 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.456220    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.456299 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.456230    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.458429 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.458413    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.458494 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.458439    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:55.459034 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.459017    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:55.459109 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.459049    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:55.459109 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.459061    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:55.461574 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.461556    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.461662 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.461578    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.461662 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.461602    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e182664070bedbec9b679d532069a9ca-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"e182664070bedbec9b679d532069a9ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.479778 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.479759    2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.484274 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.484257    2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.549586 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.549563    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.561888 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561867    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e182664070bedbec9b679d532069a9ca-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"e182664070bedbec9b679d532069a9ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.561998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561894    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.561998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561913    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.561998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561952    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.561998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561986    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e182664070bedbec9b679d532069a9ca-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"e182664070bedbec9b679d532069a9ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.562137 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.561988    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67a4b0f4a65e91b8bd1a59039b2db23a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"67a4b0f4a65e91b8bd1a59039b2db23a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.650079 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.650036    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.750888 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.750811    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.782377 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.782340    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.787358 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:55.787347    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:55.851185 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.851133    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:55.951706 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:55.951672    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.052247 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.052174    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.152809 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.152778    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.205241 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.205215    2532 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 12:50:56.205726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.205365    2532 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 12:50:56.253369 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.253347    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.299797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.299742    2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 12:45:55 +0000 UTC" deadline="2028-01-31 00:15:06.284456234 +0000 UTC"
Jul 21 12:50:56.299797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.299790    2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13403h24m9.984671533s"
Jul 21 12:50:56.353491 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.353424    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.371619 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.371597    2532 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:50:56.391105 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.391085    2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 12:50:56.391772 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:56.391730    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a4b0f4a65e91b8bd1a59039b2db23a.slice/crio-7cbb6fa04629fa5a79c1a1b6adef57e61162a91f2c6068868119b53f36a1c5b8 WatchSource:0}: Error finding container 7cbb6fa04629fa5a79c1a1b6adef57e61162a91f2c6068868119b53f36a1c5b8: Status 404 returned error can't find the container with id 7cbb6fa04629fa5a79c1a1b6adef57e61162a91f2c6068868119b53f36a1c5b8
Jul 21 12:50:56.392030 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:56.392008    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode182664070bedbec9b679d532069a9ca.slice/crio-269ac2ef30f7f514f4d9e37d7743dfb52b97cbdb261ff6c32d5a2edc0a39b90d WatchSource:0}: Error finding container 269ac2ef30f7f514f4d9e37d7743dfb52b97cbdb261ff6c32d5a2edc0a39b90d: Status 404 returned error can't find the container with id 269ac2ef30f7f514f4d9e37d7743dfb52b97cbdb261ff6c32d5a2edc0a39b90d
Jul 21 12:50:56.392364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.392346    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 12:50:56.392412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.392386    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 12:50:56.392412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.392409    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 21 12:50:56.395988 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.395914    2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 12:50:56.453937 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.453890    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.554498 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.554455    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.560904 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.560888    2532 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:50:56.654898 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:56.654827    2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 21 12:50:56.740203 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.738862    2532 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:50:56.760302 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.760278    2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:56.775599 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.775577    2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 12:50:56.776467 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.776453    2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 21 12:50:56.783721 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:56.783701    2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 12:50:57.240284 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.240251    2532 apiserver.go:52] "Watching apiserver"
Jul 21 12:50:57.251864 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.251678    2532 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 12:50:57.252213 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.252158    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","openshift-multus/multus-additional-cni-plugins-49wts","openshift-multus/network-metrics-daemon-gjq2j","openshift-network-diagnostics/network-check-target-bbgpn","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv","openshift-image-registry/node-ca-4pdg7","openshift-multus/multus-rq2k5","openshift-network-operator/iptables-alerter-tlq6k","openshift-ovn-kubernetes/ovnkube-node-sttxk","kube-system/global-pull-secret-syncer-bbcq5","kube-system/konnectivity-agent-pk8hq","openshift-cluster-node-tuning-operator/tuned-wwgjf","openshift-dns/node-resolver-tfzld"]
Jul 21 12:50:57.255687 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.255089    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.258385 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.257872    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.258385 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.258245    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 12:50:57.259150 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.258580    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.259150 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.258671    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lrcls\""
Jul 21 12:50:57.259150 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.258865    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.260351    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.260875    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.261120    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gqzh\""
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.261273    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.261361    2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 12:50:57.262037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.261400    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.263040 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.262739    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:57.263040 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.262821    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:50:57.263607 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.263233    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 12:50:57.263607 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.263369    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.263607 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.263433    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-njxm7\""
Jul 21 12:50:57.263607 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.263554    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.263873 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.263715    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 12:50:57.265181 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.265131    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.265278 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.265253    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:50:57.268128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.268111    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.270336 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.270315    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.271251 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271218    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.271467 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271453    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.271722 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271708    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg5np\""
Jul 21 12:50:57.271863 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271849    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 12:50:57.271927 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271899    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-netns\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.271927 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271920    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-daemon-config\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271935    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db14508-9239-4159-b728-f007e86e54ef-host\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271952    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-bin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271979    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-multus\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.271998    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-kubelet\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272015    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sx7x\" (UniqueName: \"kubernetes.io/projected/2557da63-2909-4711-8a6d-b6fe4b747c9f-kube-api-access-2sx7x\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272042    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272076    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-cni-binary-copy\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272104    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9db14508-9239-4159-b728-f007e86e54ef-serviceca\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272124    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc5696eb-d449-4200-a5fa-2ab379d422a7-iptables-alerter-script\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272142    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h57mz\" (UniqueName: \"kubernetes.io/projected/cc5696eb-d449-4200-a5fa-2ab379d422a7-kube-api-access-h57mz\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272193    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-system-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272229    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272260    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-conf-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272293    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl4mv\" (UniqueName: \"kubernetes.io/projected/9db14508-9239-4159-b728-f007e86e54ef-kube-api-access-wl4mv\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.272342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272328    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-cnibin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272351    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-os-release\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272395    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-socket-dir-parent\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272437    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-hostroot\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272464    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-multus-certs\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272487    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-etc-kubernetes\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272513    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc5696eb-d449-4200-a5fa-2ab379d422a7-host-slash\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.272605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272547    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-k8s-cni-cncf-io\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.272985 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.272885    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.275533 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.275506    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.275865 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.275847    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vq8nz\""
Jul 21 12:50:57.276928 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.276130    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.279119 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.279097    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 12:50:57.279216 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.279107    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 12:50:57.279326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.279267    2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 12:50:57.279451 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.279432    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-45mz8\""
Jul 21 12:50:57.280799 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.280775    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.285211 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.283896    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.285644    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.285738    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.285895    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rdfqg\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286100    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286147    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286373    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 12:50:57.286588 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286405    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.287054 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286626    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 12:50:57.287054 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.286869    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mp7dp\""
Jul 21 12:50:57.287412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.287395    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 12:50:57.287777 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.287761    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.287929 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.287900    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:50:57.290377 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.290360    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.293570 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.293385    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkslm\""
Jul 21 12:50:57.293874 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.293677    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 12:50:57.293874 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.293716    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 12:50:57.303095 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.303072    2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zzvf5"
Jul 21 12:50:57.309050 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.309030    2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 12:50:57.312801 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.312776    2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zzvf5"
Jul 21 12:50:57.357581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.357506    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"e182664070bedbec9b679d532069a9ca","Type":"ContainerStarted","Data":"269ac2ef30f7f514f4d9e37d7743dfb52b97cbdb261ff6c32d5a2edc0a39b90d"}
Jul 21 12:50:57.358866 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.358838    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"67a4b0f4a65e91b8bd1a59039b2db23a","Type":"ContainerStarted","Data":"7cbb6fa04629fa5a79c1a1b6adef57e61162a91f2c6068868119b53f36a1c5b8"}
Jul 21 12:50:57.361952 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.361934    2532 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 12:50:57.372951 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.372923    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.373103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.372963    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9db14508-9239-4159-b728-f007e86e54ef-serviceca\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.373103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.372989    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-system-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.373818 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.373795    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-system-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.373900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.373882    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-conf-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.374104 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.374084    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9db14508-9239-4159-b728-f007e86e54ef-serviceca\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.374905 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.373110    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-conf-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.374995 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.374931    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.374995 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.374973    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kube-api-access-jlh7h\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.375107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375006    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-var-lib-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375039    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-ovn\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375068    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-node-log\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375101    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-script-lib\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375140    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-k8s-cni-cncf-io\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375191    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-daemon-config\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375226    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-run\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375258    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5840726-f0a2-417d-912c-ffd43de49f34-tmp-dir\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375285    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-systemd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375315    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-lib-modules\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375344    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375384    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-os-release\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375415    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-kubelet\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375441    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-log-socket\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375472    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-modprobe-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375507    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h57mz\" (UniqueName: \"kubernetes.io/projected/cc5696eb-d449-4200-a5fa-2ab379d422a7-kube-api-access-h57mz\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375537    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-var-lib-kubelet\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.375581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375573    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375596    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-netd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375625    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovn-node-metrics-cert\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375658    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl4mv\" (UniqueName: \"kubernetes.io/projected/9db14508-9239-4159-b728-f007e86e54ef-kube-api-access-wl4mv\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375690    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-hostroot\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375723    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-multus-certs\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375747    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-etc-kubernetes\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375776    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-conf\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375807    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-system-cni-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.375852 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375845    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98c547cd-1c99-4495-b5e8-d191213e8bd2-konnectivity-ca\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375877    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc5696eb-d449-4200-a5fa-2ab379d422a7-host-slash\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375902    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysconfig\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375934    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375962    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-sys\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.375990    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-tuned\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376051    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-dbus\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.376111 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376082    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-registration-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376114    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-sys-fs\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376145    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db14508-9239-4159-b728-f007e86e54ef-host\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376177    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-bin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376208    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-etc-selinux\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376253    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cnibin\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376281    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376312    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-slash\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376340    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-bin\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376376    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-config\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.376416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376409    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-cni-binary-copy\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376442    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc5696eb-d449-4200-a5fa-2ab379d422a7-iptables-alerter-script\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376473    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376513    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rx8\" (UniqueName: \"kubernetes.io/projected/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-kube-api-access-67rx8\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376546    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-os-release\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376577    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-kubernetes\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376602    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-systemd\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376632    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-host\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376663    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376695    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-netns\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376725    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-multus\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376756    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sx7x\" (UniqueName: \"kubernetes.io/projected/2557da63-2909-4711-8a6d-b6fe4b747c9f-kube-api-access-2sx7x\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376788    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376820    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z86zz\" (UniqueName: \"kubernetes.io/projected/839a6fe1-041a-41ec-9a25-ef7ea86a5348-kube-api-access-z86zz\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376852    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376877    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-socket-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.376917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376908    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-device-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376940    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-systemd-units\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.376974    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5840726-f0a2-417d-912c-ffd43de49f34-hosts-file\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377005    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgg9\" (UniqueName: \"kubernetes.io/projected/a5840726-f0a2-417d-912c-ffd43de49f34-kube-api-access-8jgg9\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377033    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377065    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcw4s\" (UniqueName: \"kubernetes.io/projected/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-kube-api-access-fcw4s\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377096    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-etc-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377136    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377163    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-cnibin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377195    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-socket-dir-parent\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377243    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-tmp\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377277    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-netns\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377305    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-env-overrides\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377337    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98c547cd-1c99-4495-b5e8-d191213e8bd2-agent-certs\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377369    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-kubelet\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377403    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7xcx\" (UniqueName: \"kubernetes.io/projected/ba421695-3ee4-4577-901a-a9ca7d9a1159-kube-api-access-p7xcx\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377434    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-kubelet-config\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.377573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377465    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-binary-copy\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.378453 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.377659    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-k8s-cni-cncf-io\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.378453 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.378285    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-daemon-config\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.379044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379021    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-hostroot\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.379136 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379092    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-multus-certs\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.379206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379144    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-etc-kubernetes\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.379285 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379253    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc5696eb-d449-4200-a5fa-2ab379d422a7-host-slash\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.379420 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379404    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db14508-9239-4159-b728-f007e86e54ef-host\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.379491 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.379459    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-bin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.380021 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380002    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2557da63-2909-4711-8a6d-b6fe4b747c9f-cni-binary-copy\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380328    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-cni-multus\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380349    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-cni-dir\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380439    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-cnibin\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380493    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-run-netns\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380527    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc5696eb-d449-4200-a5fa-2ab379d422a7-iptables-alerter-script\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380556    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-os-release\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380561    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-multus-socket-dir-parent\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.381042 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.380625    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2557da63-2909-4711-8a6d-b6fe4b747c9f-host-var-lib-kubelet\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.386667 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.386630    2532 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 12:50:57.389105 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.389083    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:50:57.389105 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.389105    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:50:57.389280 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.389116    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:57.389280 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.389178    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:50:57.889157011 +0000 UTC m=+2.926187066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:57.390772 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.390752    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h57mz\" (UniqueName: \"kubernetes.io/projected/cc5696eb-d449-4200-a5fa-2ab379d422a7-kube-api-access-h57mz\") pod \"iptables-alerter-tlq6k\" (UID: \"cc5696eb-d449-4200-a5fa-2ab379d422a7\") " pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.390875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.390800    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl4mv\" (UniqueName: \"kubernetes.io/projected/9db14508-9239-4159-b728-f007e86e54ef-kube-api-access-wl4mv\") pod \"node-ca-4pdg7\" (UID: \"9db14508-9239-4159-b728-f007e86e54ef\") " pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.391031 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.391009    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sx7x\" (UniqueName: \"kubernetes.io/projected/2557da63-2909-4711-8a6d-b6fe4b747c9f-kube-api-access-2sx7x\") pod \"multus-rq2k5\" (UID: \"2557da63-2909-4711-8a6d-b6fe4b747c9f\") " pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.478067 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478035    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-modprobe-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478088    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-var-lib-kubelet\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478119    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478145    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-netd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478186    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovn-node-metrics-cert\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478199    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-modprobe-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478216    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-conf\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478250 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478220    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-var-lib-kubelet\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478261    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-system-cni-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478279    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478293    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98c547cd-1c99-4495-b5e8-d191213e8bd2-konnectivity-ca\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478319    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysconfig\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478333    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-conf\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478349    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478374    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-sys\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478377    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-system-cni-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478398    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-tuned\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478413    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-netd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478421    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-dbus\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478448    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-registration-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478472    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-sys-fs\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.478515 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478502    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-etc-selinux\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478526    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cnibin\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478551    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478577    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-slash\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478601    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-bin\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478624    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-config\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478656    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rx8\" (UniqueName: \"kubernetes.io/projected/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-kube-api-access-67rx8\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478681    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-kubernetes\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478718    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-sys-fs\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478705    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-systemd\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478763    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-host\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478789    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-sys\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478791    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478819    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-netns\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478877    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-run-netns\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478953    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98c547cd-1c99-4495-b5e8-d191213e8bd2-konnectivity-ca\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.478978    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-etc-selinux\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.479208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479022    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysconfig\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479027    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cnibin\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479123    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-sysctl-d\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479186    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479228    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-dbus\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479256    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-slash\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479329    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-kubernetes\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479328    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-systemd\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479379    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-host\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479391    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-cni-bin\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479589    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-registration-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479652    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z86zz\" (UniqueName: \"kubernetes.io/projected/839a6fe1-041a-41ec-9a25-ef7ea86a5348-kube-api-access-z86zz\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479679    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479705    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-socket-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479730    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-device-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479757    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-systemd-units\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479783    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5840726-f0a2-417d-912c-ffd43de49f34-hosts-file\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.480287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479810    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgg9\" (UniqueName: \"kubernetes.io/projected/a5840726-f0a2-417d-912c-ffd43de49f34-kube-api-access-8jgg9\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479836    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479862    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcw4s\" (UniqueName: \"kubernetes.io/projected/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-kube-api-access-fcw4s\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479905    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-etc-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479931    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479959    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-tmp\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479984    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-env-overrides\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479990    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5840726-f0a2-417d-912c-ffd43de49f34-hosts-file\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480009    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98c547cd-1c99-4495-b5e8-d191213e8bd2-agent-certs\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480038    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7xcx\" (UniqueName: \"kubernetes.io/projected/ba421695-3ee4-4577-901a-a9ca7d9a1159-kube-api-access-p7xcx\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480065    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-kubelet-config\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480092    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-binary-copy\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480138    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480164    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-config\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480171    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480222    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kube-api-access-jlh7h\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480250    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-var-lib-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.481163 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480278    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-ovn\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480303    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-node-log\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480330    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-script-lib\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480340    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-socket-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480359    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-run\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480386    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5840726-f0a2-417d-912c-ffd43de49f34-tmp-dir\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480404    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-device-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480413    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-systemd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480453    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-lib-modules\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480458    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-systemd-units\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480480    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480505    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-os-release\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480509    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480530    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-kubelet\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480555    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-log-socket\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480558    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-etc-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.479926    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.482059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480882    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-var-lib-openvswitch\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480938    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-ovn\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.480978    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-node-log\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481065    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481467    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovnkube-script-lib\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481495    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-env-overrides\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481544    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-run\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.481562    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481573    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-etc-tuned\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.481643    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:50:57.98162128 +0000 UTC m=+3.018651352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481688    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-os-release\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481730    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-run-systemd\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481818    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5840726-f0a2-417d-912c-ffd43de49f34-tmp-dir\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481826    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/839a6fe1-041a-41ec-9a25-ef7ea86a5348-lib-modules\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481839    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481869    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-kubelet\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481875    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-log-socket\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.482773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481884    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-ovn-node-metrics-cert\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.483403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.481924    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d23a16c-adef-4f60-b149-7f12f376512a-kubelet-config\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.483403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.482043    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.483403 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.482131    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:57.483403 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.482233    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:50:57.982214569 +0000 UTC m=+3.019244622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:57.483403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.482497    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-cni-binary-copy\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.484280 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.484247    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98c547cd-1c99-4495-b5e8-d191213e8bd2-agent-certs\") pod \"konnectivity-agent-pk8hq\" (UID: \"98c547cd-1c99-4495-b5e8-d191213e8bd2\") " pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.485430 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.485387    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839a6fe1-041a-41ec-9a25-ef7ea86a5348-tmp\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.490156 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.490137    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rx8\" (UniqueName: \"kubernetes.io/projected/2d03f5f7-676e-46f3-b3e1-cd527bf67e5c-kube-api-access-67rx8\") pod \"ovnkube-node-sttxk\" (UID: \"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.494699 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.494644    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlh7h\" (UniqueName: \"kubernetes.io/projected/a59b0cd8-86d5-440c-9bdb-8b4f8ef69701-kube-api-access-jlh7h\") pod \"aws-ebs-csi-driver-node-z25dv\" (UID: \"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.495035 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.495007    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgg9\" (UniqueName: \"kubernetes.io/projected/a5840726-f0a2-417d-912c-ffd43de49f34-kube-api-access-8jgg9\") pod \"node-resolver-tfzld\" (UID: \"a5840726-f0a2-417d-912c-ffd43de49f34\") " pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.495437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.495418    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcw4s\" (UniqueName: \"kubernetes.io/projected/c7a4c255-b3cd-4268-8473-0d3a7c8fea14-kube-api-access-fcw4s\") pod \"multus-additional-cni-plugins-49wts\" (UID: \"c7a4c255-b3cd-4268-8473-0d3a7c8fea14\") " pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.495785 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.495625    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z86zz\" (UniqueName: \"kubernetes.io/projected/839a6fe1-041a-41ec-9a25-ef7ea86a5348-kube-api-access-z86zz\") pod \"tuned-wwgjf\" (UID: \"839a6fe1-041a-41ec-9a25-ef7ea86a5348\") " pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.496081 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.496063    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7xcx\" (UniqueName: \"kubernetes.io/projected/ba421695-3ee4-4577-901a-a9ca7d9a1159-kube-api-access-p7xcx\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.569617 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.569588    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pdg7"
Jul 21 12:50:57.585734 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.585712    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlq6k"
Jul 21 12:50:57.596488 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.596469    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rq2k5"
Jul 21 12:50:57.604293 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.604275    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv"
Jul 21 12:50:57.610259 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.610238    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwgjf"
Jul 21 12:50:57.619011 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.618988    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49wts"
Jul 21 12:50:57.628876 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.628858    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:50:57.636862 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.636842    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:50:57.642794 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.642776    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfzld"
Jul 21 12:50:57.985863 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.985825    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:57.986072 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.985902    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:57.986072 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:57.985934    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:57.986072 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986018    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:57.986072 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986039    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986089    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:50:58.986065521 +0000 UTC m=+4.023095590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986107    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:50:58.986099937 +0000 UTC m=+4.023129992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986151    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986170    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986183    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:57.986328 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:57.986256    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:50:58.986233453 +0000 UTC m=+4.023263506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:58.318577 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:58.318456    2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 12:45:57 +0000 UTC" deadline="2027-12-30 00:10:51.921901096 +0000 UTC"
Jul 21 12:50:58.318577 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:58.318505    2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12635h19m53.603410375s"
Jul 21 12:50:58.652486 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:58.652459    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a4c255_b3cd_4268_8473_0d3a7c8fea14.slice/crio-02f9cd68d90ea0bbe4ffe6b421a008b7a46c9be24d1d1cc5b16ff74d21e26a00 WatchSource:0}: Error finding container 02f9cd68d90ea0bbe4ffe6b421a008b7a46c9be24d1d1cc5b16ff74d21e26a00: Status 404 returned error can't find the container with id 02f9cd68d90ea0bbe4ffe6b421a008b7a46c9be24d1d1cc5b16ff74d21e26a00
Jul 21 12:50:58.654494 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:58.654464    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5696eb_d449_4200_a5fa_2ab379d422a7.slice/crio-20351479200b8c8aeea428d05e4e47ab20395d61c05203e276a0f235dde379ff WatchSource:0}: Error finding container 20351479200b8c8aeea428d05e4e47ab20395d61c05203e276a0f235dde379ff: Status 404 returned error can't find the container with id 20351479200b8c8aeea428d05e4e47ab20395d61c05203e276a0f235dde379ff
Jul 21 12:50:58.666608 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:58.666581    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59b0cd8_86d5_440c_9bdb_8b4f8ef69701.slice/crio-f5f945d1edb454e7a8f0262611b9e8764386307466ca02649bcb89fc704d9e0e WatchSource:0}: Error finding container f5f945d1edb454e7a8f0262611b9e8764386307466ca02649bcb89fc704d9e0e: Status 404 returned error can't find the container with id f5f945d1edb454e7a8f0262611b9e8764386307466ca02649bcb89fc704d9e0e
Jul 21 12:50:58.667538 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:58.667514    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2557da63_2909_4711_8a6d_b6fe4b747c9f.slice/crio-a6da31887ff73aeda4540534b7705b21a9431b5de7f36dcf0cc492a6eced03b0 WatchSource:0}: Error finding container a6da31887ff73aeda4540534b7705b21a9431b5de7f36dcf0cc492a6eced03b0: Status 404 returned error can't find the container with id a6da31887ff73aeda4540534b7705b21a9431b5de7f36dcf0cc492a6eced03b0
Jul 21 12:50:58.671079 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:50:58.670994    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5840726_f0a2_417d_912c_ffd43de49f34.slice/crio-302017614b2fe4138c0fbdb03e8d6774e688b3bdecb712e82a735587776e0ff0 WatchSource:0}: Error finding container 302017614b2fe4138c0fbdb03e8d6774e688b3bdecb712e82a735587776e0ff0: Status 404 returned error can't find the container with id 302017614b2fe4138c0fbdb03e8d6774e688b3bdecb712e82a735587776e0ff0
Jul 21 12:50:58.993132 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:58.992923    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:58.993349 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993104    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:58.993349 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993279    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:51:00.993256727 +0000 UTC m=+6.030286786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:50:58.993349 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:58.993206    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:58.993349 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993319    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:50:58.993349 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993344    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:50:58.993610 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993358    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:58.993610 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:58.993361    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:58.993610 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993408    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:00.993393071 +0000 UTC m=+6.030423137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:50:58.993610 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993468    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:58.993610 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:58.993511    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:00.993501246 +0000 UTC m=+6.030531304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:50:59.319264 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.319175    2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 12:45:57 +0000 UTC" deadline="2028-05-02 13:11:07.41435524 +0000 UTC"
Jul 21 12:50:59.319264 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.319238    2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15624h20m8.095122035s"
Jul 21 12:50:59.355308 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.355273    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:50:59.355505 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:59.355417    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:50:59.355877 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.355854    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:50:59.355987 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:59.355965    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:50:59.356052 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.356044    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:50:59.356155 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:50:59.356134    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:50:59.366676 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.366635    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pdg7" event={"ID":"9db14508-9239-4159-b728-f007e86e54ef","Type":"ContainerStarted","Data":"1bc99c5d60db9488eb1751e114d246ebd90a5c411db62353df4c06488e85e3ce"}
Jul 21 12:50:59.369636 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.369609    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlq6k" event={"ID":"cc5696eb-d449-4200-a5fa-2ab379d422a7","Type":"ContainerStarted","Data":"20351479200b8c8aeea428d05e4e47ab20395d61c05203e276a0f235dde379ff"}
Jul 21 12:50:59.372593 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.372559    2532 generic.go:356] "Generic (PLEG): container finished" podID="67a4b0f4a65e91b8bd1a59039b2db23a" containerID="b976221fc5037739f696d123192262d918619a8e02ad05cad5b1fea7e887ff76" exitCode=0
Jul 21 12:50:59.372700 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.372651    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"67a4b0f4a65e91b8bd1a59039b2db23a","Type":"ContainerDied","Data":"b976221fc5037739f696d123192262d918619a8e02ad05cad5b1fea7e887ff76"}
Jul 21 12:50:59.380244 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.380200    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"e182664070bedbec9b679d532069a9ca","Type":"ContainerStarted","Data":"2c3b43955725d0896107d17890c8cdfc9b7bd1c3acd000ec447f10d959e17040"}
Jul 21 12:50:59.382262 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.382220    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfzld" event={"ID":"a5840726-f0a2-417d-912c-ffd43de49f34","Type":"ContainerStarted","Data":"302017614b2fe4138c0fbdb03e8d6774e688b3bdecb712e82a735587776e0ff0"}
Jul 21 12:50:59.384356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.384327    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwgjf" event={"ID":"839a6fe1-041a-41ec-9a25-ef7ea86a5348","Type":"ContainerStarted","Data":"743a04f6cc40e58bd303f667c6a886c8096c8d7dd263a25eaec046c270011a69"}
Jul 21 12:50:59.386571 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.386540    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv" event={"ID":"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701","Type":"ContainerStarted","Data":"f5f945d1edb454e7a8f0262611b9e8764386307466ca02649bcb89fc704d9e0e"}
Jul 21 12:50:59.389005 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.388980    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"5d8acd5745aaefbb81bb40c492b53828c40837a3167d782a2f332a610eb30140"}
Jul 21 12:50:59.390871 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.390845    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk8hq" event={"ID":"98c547cd-1c99-4495-b5e8-d191213e8bd2","Type":"ContainerStarted","Data":"6f3f9b1886ff369f0416a3026e669cc48a6e8607c2de6eba41a5ad001820257e"}
Jul 21 12:50:59.396595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.396564    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerStarted","Data":"02f9cd68d90ea0bbe4ffe6b421a008b7a46c9be24d1d1cc5b16ff74d21e26a00"}
Jul 21 12:50:59.405843 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.405795    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rq2k5" event={"ID":"2557da63-2909-4711-8a6d-b6fe4b747c9f","Type":"ContainerStarted","Data":"a6da31887ff73aeda4540534b7705b21a9431b5de7f36dcf0cc492a6eced03b0"}
Jul 21 12:50:59.418356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:50:59.418300    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" podStartSLOduration=2.418280047 podStartE2EDuration="2.418280047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:50:59.41748034 +0000 UTC m=+4.454510417" watchObservedRunningTime="2026-07-21 12:50:59.418280047 +0000 UTC m=+4.455310129"
Jul 21 12:51:00.417624 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:00.417585    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"67a4b0f4a65e91b8bd1a59039b2db23a","Type":"ContainerStarted","Data":"b794bcaf0468bcb5c94b0bbdc2825d92f534d72ee38940468989f9491af6760b"}
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.014313    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.014367    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.014409    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014555    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014616    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:51:05.014596991 +0000 UTC m=+10.051627058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014706    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014720    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014732    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014771    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:05.014759102 +0000 UTC m=+10.051789160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014835    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:01.015434 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.014869    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:05.014857472 +0000 UTC m=+10.051887530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.354827    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.354971    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.355390    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.355481    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:01.355545    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:01.355789 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:01.355617    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:03.356790 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:03.356764    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:03.357198 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:03.356898    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:03.357284 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:03.357247    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:03.357369 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:03.357347    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:03.357369 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:03.357350    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:03.357494 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:03.357443    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:05.048956 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.048920    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.048973    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.049014    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049074    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049096    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049109    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049116    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049183    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:13.049144953 +0000 UTC m=+18.086175009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049200    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049205    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:51:13.049194639 +0000 UTC m=+18.086224696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:05.049406 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.049231    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:13.049220811 +0000 UTC m=+18.086250866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:05.360631 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.360553    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:05.360780 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.360743    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:05.361205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.361183    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:05.361369 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.361346    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:05.361444 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:05.361429    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:05.361559 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:05.361540    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:07.352276    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:07.352315    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:07.352276    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:07.352413    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:07.352495    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:07.352741 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:07.352593    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:09.353035 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.352811    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:09.353389 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.352818    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:09.353389 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:09.353141    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:09.353389 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.352897    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:09.353389 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:09.353261    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:09.353389 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:09.353341    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:09.436881 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.436827    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfzld" event={"ID":"a5840726-f0a2-417d-912c-ffd43de49f34","Type":"ContainerStarted","Data":"b2a50f064dff245e9c1a76a007adf10760a98b1d95cec78c727e290a0d7a3e25"}
Jul 21 12:51:09.438952 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.438925    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwgjf" event={"ID":"839a6fe1-041a-41ec-9a25-ef7ea86a5348","Type":"ContainerStarted","Data":"282891e82b5df41cf0528881c7abe4abb214249f8d649aedf98a43a132fd15f2"}
Jul 21 12:51:09.441260 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.441240    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv" event={"ID":"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701","Type":"ContainerStarted","Data":"5d256a280eb7f4273f0c802b03aa37317409d219c1e101c0370bd898c78cd03e"}
Jul 21 12:51:09.442832 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.442795    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk8hq" event={"ID":"98c547cd-1c99-4495-b5e8-d191213e8bd2","Type":"ContainerStarted","Data":"39d7e751f0615a25a8f1bfb0ee0134f799fbd5ef155480d87dd060496bd4908b"}
Jul 21 12:51:09.444657 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.444632    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="09a7bbfd2d92c3c480b61ec10412533e9ce44de1821935c4b83d01167d9388a4" exitCode=0
Jul 21 12:51:09.444763 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.444710    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"09a7bbfd2d92c3c480b61ec10412533e9ce44de1821935c4b83d01167d9388a4"}
Jul 21 12:51:09.446425 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.446391    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pdg7" event={"ID":"9db14508-9239-4159-b728-f007e86e54ef","Type":"ContainerStarted","Data":"4a8e69aa4942568882ced62d582a47f8185708316017448666c21855622a08a7"}
Jul 21 12:51:09.458422 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.458381    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tfzld" podStartSLOduration=3.048572064 podStartE2EDuration="13.458368817s" totalImagesPullingTime="10.409796753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:09.457827071 +0000 UTC m=+14.494857147" watchObservedRunningTime="2026-07-21 12:51:09.458368817 +0000 UTC m=+14.495398892"
Jul 21 12:51:09.458541 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.458473    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" podStartSLOduration=12.458464249 podStartE2EDuration="12.458464249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:00.441504204 +0000 UTC m=+5.478534281" watchObservedRunningTime="2026-07-21 12:51:09.458464249 +0000 UTC m=+14.495494324"
Jul 21 12:51:09.474373 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.474336    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pk8hq" podStartSLOduration=3.067775602 podStartE2EDuration="13.474325876s" totalImagesPullingTime="10.406550274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:09.47361713 +0000 UTC m=+14.510647204" watchObservedRunningTime="2026-07-21 12:51:09.474325876 +0000 UTC m=+14.511355950"
Jul 21 12:51:09.490905 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.490862    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wwgjf" podStartSLOduration=3.076651259 podStartE2EDuration="13.490848176s" totalImagesPullingTime="10.414196917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:09.490411909 +0000 UTC m=+14.527441984" watchObservedRunningTime="2026-07-21 12:51:09.490848176 +0000 UTC m=+14.527878251"
Jul 21 12:51:09.553666 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:09.553567    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4pdg7" podStartSLOduration=4.143283189 podStartE2EDuration="14.553551559s" totalImagesPullingTime="10.41026837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:09.50652956 +0000 UTC m=+14.543559634" watchObservedRunningTime="2026-07-21 12:51:09.553551559 +0000 UTC m=+14.590581650"
Jul 21 12:51:11.181533 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.181382    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:51:11.182135 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.182033    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:51:11.355548 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.355516    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:11.355548 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.355532    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:11.355548 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.355525    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:11.355815 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:11.355657    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:11.355815 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:11.355699    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:11.355815 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:11.355739    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:11.452274 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.452237    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlq6k" event={"ID":"cc5696eb-d449-4200-a5fa-2ab379d422a7","Type":"ContainerStarted","Data":"aaa5681daafa16032ff7f130dd50549a1f3ffdd3a45cf20095b5069816146713"}
Jul 21 12:51:11.470261 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:11.470202    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tlq6k" podStartSLOduration=6.053564619 podStartE2EDuration="16.47018637s" totalImagesPullingTime="10.416621751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:11.469110665 +0000 UTC m=+16.506140742" watchObservedRunningTime="2026-07-21 12:51:11.47018637 +0000 UTC m=+16.507216434"
Jul 21 12:51:12.455593 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:12.455210    2532 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 12:51:13.111229 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.111192    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:13.111377 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.111234    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:13.111377 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.111279    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:13.111377 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111366    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:13.111377 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111368    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111395    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111406    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111427    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111435    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:51:29.111418598 +0000 UTC m=+34.148448666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111500    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:29.111482432 +0000 UTC m=+34.148512484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:13.111562 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.111521    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:29.111513321 +0000 UTC m=+34.148543372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:13.355653 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.355620    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:13.355810 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.355620    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:13.355810 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.355746    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:13.355810 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:13.355620    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:13.355975 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.355808    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:13.355975 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:13.355910    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:15.353050 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:15.353018    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:15.353728 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:15.353107    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:15.353728 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:15.353242    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:15.353728 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:15.353360    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:15.353728 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:15.353372    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:15.353728 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:15.353474    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:17.352406    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:17.352411    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:17.352624    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:17.352523    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:17.352678    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:17.354145 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:17.352747    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:19.355548 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.355303    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:19.355971 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.355360    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:19.355971 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.355366    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:19.356244 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:19.356110    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:19.356386 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:19.356340    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:19.356631 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:19.356466    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:19.744638 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.744601    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:51:19.744830 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.744801    2532 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 12:51:19.745601 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:19.745573    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pk8hq"
Jul 21 12:51:20.648013 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:20.647982    2532 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 12:51:21.332438 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.332205    2532 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T12:51:20.64799834Z","UUID":"3d7f55e9-176d-4891-b094-20d5c016e4d2","Handler":null,"Name":"","Endpoint":""}
Jul 21 12:51:21.333798 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.333775    2532 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 12:51:21.333936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.333816    2532 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 12:51:21.351971 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.351941    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:21.351971 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.351972    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:21.352193 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:21.352064    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:21.352193 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:21.352102    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:21.352193 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.352146    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:21.352370 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:21.352247    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:21.475847 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.475764    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv" event={"ID":"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701","Type":"ContainerStarted","Data":"38ea92a95adcfa96c969f6e8b4a7863b8e17ecf6e877cd0bd7dfecdc4537a657"}
Jul 21 12:51:21.479326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479290    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"36fd52a602952c71909275870ed58ed146f92adebf68179bbd6d63b1634f814a"}
Jul 21 12:51:21.479483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479367    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"823535e4e04504a7ee757c5d534815516bd1ff5d9f33a304a0d83009fc96956d"}
Jul 21 12:51:21.479483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479399    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"14196860e81fad1becabcaf5d1607459dfcf9d31af0fecb3c566f65cd5d3d0e1"}
Jul 21 12:51:21.479483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479443    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"23d0b985abafff984457587f5278333807255634fa6630a87398f3aa61c35155"}
Jul 21 12:51:21.479643 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479488    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"ce886b28dac9cf7cd328f64bb8d2f50ee604c729891e5f69f7d6d6738ee3472a"}
Jul 21 12:51:21.479643 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.479530    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"a2c4d140a076f8d1630905935511f0dca99a91f100a90a1260f9a8ef87e942df"}
Jul 21 12:51:21.481638 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.481613    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="ff12d755e05d7dda11ea891d838754e5db2296fdbd55044d1da4f40f93e1e015" exitCode=0
Jul 21 12:51:21.481749 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.481697    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"ff12d755e05d7dda11ea891d838754e5db2296fdbd55044d1da4f40f93e1e015"}
Jul 21 12:51:21.483132 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.483093    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rq2k5" event={"ID":"2557da63-2909-4711-8a6d-b6fe4b747c9f","Type":"ContainerStarted","Data":"df1a7942750cd272cca848dda8db6528cb84e960b408c2c8dfd357a9db535c19"}
Jul 21 12:51:21.524812 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:21.524769    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rq2k5" podStartSLOduration=6.202127493 podStartE2EDuration="26.524755787s" totalImagesPullingTime="20.322628294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:21.524623907 +0000 UTC m=+26.561653983" watchObservedRunningTime="2026-07-21 12:51:21.524755787 +0000 UTC m=+26.561785861"
Jul 21 12:51:22.487445 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:22.487415    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="cb458b43947a7aef53487c0124fa56d000831117111a423b4e6e6c4f66cd3735" exitCode=0
Jul 21 12:51:22.487895 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:22.487486    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"cb458b43947a7aef53487c0124fa56d000831117111a423b4e6e6c4f66cd3735"}
Jul 21 12:51:22.489577 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:22.489554    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv" event={"ID":"a59b0cd8-86d5-440c-9bdb-8b4f8ef69701","Type":"ContainerStarted","Data":"b9901826f72d37496105c30719f3bfb6f5198c1bdaf55f3637235406dbdc3b7b"}
Jul 21 12:51:22.530012 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:22.529972    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z25dv" podStartSLOduration=5.510464163 podStartE2EDuration="26.529955667s" totalImagesPullingTime="21.019491504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:22.529877649 +0000 UTC m=+27.566907722" watchObservedRunningTime="2026-07-21 12:51:22.529955667 +0000 UTC m=+27.566985744"
Jul 21 12:51:23.352756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:23.352728    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:23.352756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:23.352746    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:23.352984 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:23.352832    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:23.352984 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:23.352896    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:23.352984 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:23.352910    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:23.353146 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:23.352984    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:23.495104 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:23.495073    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"9d2c0a252e41ce7efcec34416b9e71de53595e554f0c5c6f598be49bb12bc053"}
Jul 21 12:51:24.499372 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:24.499336    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="55f1f53786cd9213026354e4c7adf1c583b7f738159e47cadf17ce316837b6bf" exitCode=0
Jul 21 12:51:24.499372 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:24.499374    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"55f1f53786cd9213026354e4c7adf1c583b7f738159e47cadf17ce316837b6bf"}
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.356450    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.356531    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:25.356700    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:25.356782    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.356585    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:25.357594 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:25.356882    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:25.505385 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.505354    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" event={"ID":"2d03f5f7-676e-46f3-b3e1-cd527bf67e5c","Type":"ContainerStarted","Data":"e701ed05db0f59d0d405f1eb5ce5d9af8b201e0bc9375125ddd804ce6b1e7fb4"}
Jul 21 12:51:25.505875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.505605    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:51:25.522980 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.522956    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:51:25.539076 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:25.539017    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk" podStartSLOduration=7.661911934 podStartE2EDuration="29.539004415s" totalImagesPullingTime="21.877092481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:25.536990149 +0000 UTC m=+30.574020236" watchObservedRunningTime="2026-07-21 12:51:25.539004415 +0000 UTC m=+30.576034488"
Jul 21 12:51:26.509304 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:26.509270    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:51:26.511181 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:26.509359    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:51:26.560166 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:26.556735    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:51:27.355777 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.355746    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:27.355961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.355852    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:27.355961 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.355867    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:27.355961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.355886    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:27.356112 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.355968    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:27.356112 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.356059    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:27.471900 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.471865    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbcq5"]
Jul 21 12:51:27.474345 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.474319    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gjq2j"]
Jul 21 12:51:27.477199 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.477176    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbgpn"]
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.510545    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.510560    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:27.510547    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.510664    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.510778    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:27.511147 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:27.511112    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:29.134857 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.134823    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.134862    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.134901    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.134994    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135002    2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135017    2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135030    2532 projected.go:196] Error preparing data for projected volume kube-api-access-77jv2 for pod openshift-network-diagnostics/network-check-target-bbgpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135056    2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135076    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2 podName:04f9f338-d8e4-4c89-a516-218939bc2903 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:01.135058408 +0000 UTC m=+66.172088461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-77jv2" (UniqueName: "kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2") pod "network-check-target-bbgpn" (UID: "04f9f338-d8e4-4c89-a516-218939bc2903") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135095    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret podName:3d23a16c-adef-4f60-b149-7f12f376512a nodeName:}" failed. No retries permitted until 2026-07-21 12:52:01.135085859 +0000 UTC m=+66.172115915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret") pod "global-pull-secret-syncer-bbcq5" (UID: "3d23a16c-adef-4f60-b149-7f12f376512a") : object "kube-system"/"original-pull-secret" not registered
Jul 21 12:51:29.135272 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.135124    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs podName:ba421695-3ee4-4577-901a-a9ca7d9a1159 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:01.135105182 +0000 UTC m=+66.172135258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs") pod "network-metrics-daemon-gjq2j" (UID: "ba421695-3ee4-4577-901a-a9ca7d9a1159") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 12:51:29.352224 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.352196    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:29.352339 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.352226    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:29.352339 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.352197    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:29.352339 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.352327    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:29.352515 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.352423    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:29.352559 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:29.352511    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:29.518024 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:29.517984    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerStarted","Data":"fb85d911130b60284189755e31f9573641f7970962aa78a00c0e7b3e4c8426c8"}
Jul 21 12:51:30.523296 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:30.523117    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="fb85d911130b60284189755e31f9573641f7970962aa78a00c0e7b3e4c8426c8" exitCode=0
Jul 21 12:51:30.523296 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:30.523198    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"fb85d911130b60284189755e31f9573641f7970962aa78a00c0e7b3e4c8426c8"}
Jul 21 12:51:31.352531 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:31.352503    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:31.352531 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:31.352520    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:31.352763 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:31.352514    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:31.352763 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:31.352599    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gjq2j" podUID="ba421695-3ee4-4577-901a-a9ca7d9a1159"
Jul 21 12:51:31.352763 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:31.352678    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbgpn" podUID="04f9f338-d8e4-4c89-a516-218939bc2903"
Jul 21 12:51:31.352921 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:31.352762    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbcq5" podUID="3d23a16c-adef-4f60-b149-7f12f376512a"
Jul 21 12:51:31.528318 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:31.528287    2532 generic.go:356] "Generic (PLEG): container finished" podID="c7a4c255-b3cd-4268-8473-0d3a7c8fea14" containerID="570652053ae842921def3d7c937ec861dd5b7e72ff52351a115eed1bcca443dd" exitCode=0
Jul 21 12:51:31.528730 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:31.528328    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerDied","Data":"570652053ae842921def3d7c937ec861dd5b7e72ff52351a115eed1bcca443dd"}
Jul 21 12:51:32.533226 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:32.533191    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49wts" event={"ID":"c7a4c255-b3cd-4268-8473-0d3a7c8fea14","Type":"ContainerStarted","Data":"178188f0e37c30974dc524d6e10abc7921c67df424ccb3fd402c1ae8e319e2ac"}
Jul 21 12:51:32.559399 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:32.559353    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-49wts" podStartSLOduration=8.063907247 podStartE2EDuration="36.559339682s" totalImagesPullingTime="28.495432435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:32.557952533 +0000 UTC m=+37.594982606" watchObservedRunningTime="2026-07-21 12:51:32.559339682 +0000 UTC m=+37.596369756"
Jul 21 12:51:33.270530 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.270502    2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeReady"
Jul 21 12:51:33.270722 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.270641    2532 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 12:51:33.304750 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.304722    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"]
Jul 21 12:51:33.327128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.327092    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-chwf8"]
Jul 21 12:51:33.327324 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.327240    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"
Jul 21 12:51:33.330345 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.330314    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.330470 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.330360    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gpng2\""
Jul 21 12:51:33.330637 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.330621    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.340770 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.340749    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"]
Jul 21 12:51:33.340883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.340863    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.348143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.347910    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.348143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.348006    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 12:51:33.348143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.348033    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.348143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.348136    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 12:51:33.348593 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.348569    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dm6p5\""
Jul 21 12:51:33.350021 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.350003    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 12:51:33.359003 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.358979    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"]
Jul 21 12:51:33.359107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.359090    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.362071 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.362053    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.362310 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.362296    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 12:51:33.362361 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.362319    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.362559 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.362543    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zqxcb\""
Jul 21 12:51:33.362645 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.362549    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 12:51:33.379237 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.379217    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.382119 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.382099    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 12:51:33.382119 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.382119    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.382287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.382104    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.382287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.382131    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x22rq\""
Jul 21 12:51:33.382814 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.382797    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"]
Jul 21 12:51:33.405024 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.405003    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:51:33.405133 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.405118    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.407981 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.407964    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 12:51:33.408166 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.408126    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.408166 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.408138    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m8skx\""
Jul 21 12:51:33.408296 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.408203    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.408371 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.408308    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 12:51:33.425069 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.425046    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"]
Jul 21 12:51:33.425207 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.425191    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.428098 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.428078    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 12:51:33.428197 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.428078    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 12:51:33.428365 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.428352    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjwbz\""
Jul 21 12:51:33.428413 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.428354    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 12:51:33.436028 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.436010    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 12:51:33.451326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451306    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451330    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-chwf8"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451342    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451357    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451369    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451381    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451392    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451394    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:51:33.451403 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451406    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzwps"]
Jul 21 12:51:33.451661 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451407    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"
Jul 21 12:51:33.451661 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451413    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:51:33.451661 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.451537    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:51:33.454416 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454400    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.454509 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454417    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.454564 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454504    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 12:51:33.454619 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454580    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ccp9\""
Jul 21 12:51:33.454669 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454642    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 12:51:33.454669 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454664    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fm4dg\""
Jul 21 12:51:33.454810 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.454799    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtsf5\""
Jul 21 12:51:33.466296 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466275    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9cph\" (UniqueName: \"kubernetes.io/projected/d069bce7-b06e-4aa0-8302-7425913e90c4-kube-api-access-w9cph\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.466451 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466428    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmck2\" (UniqueName: \"kubernetes.io/projected/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-kube-api-access-fmck2\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.466547 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466492    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-trusted-ca\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.466547 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466537    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc49707d-38d8-4c58-8c98-b65975756230-serving-cert\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.466626 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466610    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j746g\" (UniqueName: \"kubernetes.io/projected/dc49707d-38d8-4c58-8c98-b65975756230-kube-api-access-j746g\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.466670 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466636    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d069bce7-b06e-4aa0-8302-7425913e90c4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.466670 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466654    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d069bce7-b06e-4aa0-8302-7425913e90c4-config\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.466745 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466691    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknjt\" (UniqueName: \"kubernetes.io/projected/c6da096e-eaf1-43d8-b034-322c491b5af7-kube-api-access-kknjt\") pod \"volume-data-source-validator-78cf4c6f6-9nkjz\" (UID: \"c6da096e-eaf1-43d8-b034-322c491b5af7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"
Jul 21 12:51:33.466745 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466707    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-config\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.466745 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.466733    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.471315 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.471295    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rqsdz"]
Jul 21 12:51:33.471408 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.471390    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.474401 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.474373    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 12:51:33.474555 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.474537    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 12:51:33.474638 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.474570    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kg652\""
Jul 21 12:51:33.474638 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.474615    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 12:51:33.492747 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.492729    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzwps"]
Jul 21 12:51:33.492835 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.492772    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqsdz"]
Jul 21 12:51:33.492871 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.492836    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.496484 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.496469    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 12:51:33.496586 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.496512    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 12:51:33.496586 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.496559    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kcsl4\""
Jul 21 12:51:33.567916 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.567859    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvsh7\" (UniqueName: \"kubernetes.io/projected/cec5939d-0f1d-4813-8b9d-aad704d988ed-kube-api-access-zvsh7\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.567916 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.567884    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.567917    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j746g\" (UniqueName: \"kubernetes.io/projected/dc49707d-38d8-4c58-8c98-b65975756230-kube-api-access-j746g\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.567934    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568040    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d069bce7-b06e-4aa0-8302-7425913e90c4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568058    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d069bce7-b06e-4aa0-8302-7425913e90c4-config\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568076    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cc14403-b3ed-4615-a8a4-ed36a2e38295-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568174    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568234    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kknjt\" (UniqueName: \"kubernetes.io/projected/c6da096e-eaf1-43d8-b034-322c491b5af7-kube-api-access-kknjt\") pod \"volume-data-source-validator-78cf4c6f6-9nkjz\" (UID: \"c6da096e-eaf1-43d8-b034-322c491b5af7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"
Jul 21 12:51:33.568286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568262    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-config\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568288    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568312    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568337    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47tvc\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.568419    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568461    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9cph\" (UniqueName: \"kubernetes.io/projected/d069bce7-b06e-4aa0-8302-7425913e90c4-kube-api-access-w9cph\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.568481    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:51:34.068465048 +0000 UTC m=+39.105495122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568511    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmck2\" (UniqueName: \"kubernetes.io/projected/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-kube-api-access-fmck2\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568538    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc14403-b3ed-4615-a8a4-ed36a2e38295-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568562    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.568629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568615    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx8cv\" (UniqueName: \"kubernetes.io/projected/5cc14403-b3ed-4615-a8a4-ed36a2e38295-kube-api-access-zx8cv\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568641    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9456n\" (UniqueName: \"kubernetes.io/projected/6df863a6-3d65-4b48-a286-b7c7f8c77bfe-kube-api-access-9456n\") pod \"network-check-source-7bc5b6bf85-wjwsv\" (UID: \"6df863a6-3d65-4b48-a286-b7c7f8c77bfe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568668    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-trusted-ca\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568691    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d069bce7-b06e-4aa0-8302-7425913e90c4-config\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568722    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568784    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc49707d-38d8-4c58-8c98-b65975756230-serving-cert\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568814    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cec5939d-0f1d-4813-8b9d-aad704d988ed-cert\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.568840    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.569128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.569016    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-config\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.569674 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.569654    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc49707d-38d8-4c58-8c98-b65975756230-trusted-ca\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.572140 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.572120    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d069bce7-b06e-4aa0-8302-7425913e90c4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.572274 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.572258    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc49707d-38d8-4c58-8c98-b65975756230-serving-cert\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.577981 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.577931    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknjt\" (UniqueName: \"kubernetes.io/projected/c6da096e-eaf1-43d8-b034-322c491b5af7-kube-api-access-kknjt\") pod \"volume-data-source-validator-78cf4c6f6-9nkjz\" (UID: \"c6da096e-eaf1-43d8-b034-322c491b5af7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"
Jul 21 12:51:33.578409 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.578388    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j746g\" (UniqueName: \"kubernetes.io/projected/dc49707d-38d8-4c58-8c98-b65975756230-kube-api-access-j746g\") pod \"console-operator-565b7b569d-chwf8\" (UID: \"dc49707d-38d8-4c58-8c98-b65975756230\") " pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.578758 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.578737    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmck2\" (UniqueName: \"kubernetes.io/projected/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-kube-api-access-fmck2\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:33.579776 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.579753    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9cph\" (UniqueName: \"kubernetes.io/projected/d069bce7-b06e-4aa0-8302-7425913e90c4-kube-api-access-w9cph\") pod \"service-ca-operator-5bcbc94c78-7q669\" (UID: \"d069bce7-b06e-4aa0-8302-7425913e90c4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.638201 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.638182    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"
Jul 21 12:51:33.650390 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.650368    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:33.668096 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.668082    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"
Jul 21 12:51:33.669328 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669305    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cc14403-b3ed-4615-a8a4-ed36a2e38295-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.669404 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669340    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669492 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669475    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669542 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669528    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.669602 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669587    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx8cv\" (UniqueName: \"kubernetes.io/projected/5cc14403-b3ed-4615-a8a4-ed36a2e38295-kube-api-access-zx8cv\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.669644 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669618    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfzhj\" (UniqueName: \"kubernetes.io/projected/fff55b44-4976-4333-bb89-9a157e59dbd8-kube-api-access-mfzhj\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.669692 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669650    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669692 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669676    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvsh7\" (UniqueName: \"kubernetes.io/projected/cec5939d-0f1d-4813-8b9d-aad704d988ed-kube-api-access-zvsh7\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.669777 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669701    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fff55b44-4976-4333-bb89-9a157e59dbd8-config-volume\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.669777 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669767    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc14403-b3ed-4615-a8a4-ed36a2e38295-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.669869 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669806    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47tvc\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669869 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669860    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669870    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.669958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669879    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cc14403-b3ed-4615-a8a4-ed36a2e38295-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.669958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.669876    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9456n\" (UniqueName: \"kubernetes.io/projected/6df863a6-3d65-4b48-a286-b7c7f8c77bfe-kube-api-access-9456n\") pod \"network-check-source-7bc5b6bf85-wjwsv\" (UID: \"6df863a6-3d65-4b48-a286-b7c7f8c77bfe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"
Jul 21 12:51:33.670090 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.670061    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.670223 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.670181    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:33.670223 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.670188    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cec5939d-0f1d-4813-8b9d-aad704d988ed-cert\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.670223 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.670201    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:33.670406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.670330    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.673057 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673031    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.673233 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.673212    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:34.172682893 +0000 UTC m=+39.209712950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:33.673338 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673313    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.673404 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673350    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff55b44-4976-4333-bb89-9a157e59dbd8-tmp-dir\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.673404 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673375    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.674337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673518    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc14403-b3ed-4615-a8a4-ed36a2e38295-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.674337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673671    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.674337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.673760    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cec5939d-0f1d-4813-8b9d-aad704d988ed-cert\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.674337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.674304    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.685702 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.685684    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx8cv\" (UniqueName: \"kubernetes.io/projected/5cc14403-b3ed-4615-a8a4-ed36a2e38295-kube-api-access-zx8cv\") pod \"kube-storage-version-migrator-operator-7658d9b749-s5wwx\" (UID: \"5cc14403-b3ed-4615-a8a4-ed36a2e38295\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.685867 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.685844    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9456n\" (UniqueName: \"kubernetes.io/projected/6df863a6-3d65-4b48-a286-b7c7f8c77bfe-kube-api-access-9456n\") pod \"network-check-source-7bc5b6bf85-wjwsv\" (UID: \"6df863a6-3d65-4b48-a286-b7c7f8c77bfe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"
Jul 21 12:51:33.685921 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.685900    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvsh7\" (UniqueName: \"kubernetes.io/projected/cec5939d-0f1d-4813-8b9d-aad704d988ed-kube-api-access-zvsh7\") pod \"ingress-canary-gzwps\" (UID: \"cec5939d-0f1d-4813-8b9d-aad704d988ed\") " pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.697102 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.697080    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.697547 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.697528    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47tvc\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:33.713438 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.713397    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.774480    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff55b44-4976-4333-bb89-9a157e59dbd8-tmp-dir\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.774740    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.774792    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfzhj\" (UniqueName: \"kubernetes.io/projected/fff55b44-4976-4333-bb89-9a157e59dbd8-kube-api-access-mfzhj\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.774832    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fff55b44-4976-4333-bb89-9a157e59dbd8-config-volume\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.775371    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fff55b44-4976-4333-bb89-9a157e59dbd8-config-volume\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.775553    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff55b44-4976-4333-bb89-9a157e59dbd8-tmp-dir\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.775629    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:33.776205 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:33.775676    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:34.275662451 +0000 UTC m=+39.312692504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:33.777923 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.777703    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"
Jul 21 12:51:33.782389 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.782329    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzwps"
Jul 21 12:51:33.789190 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.788905    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfzhj\" (UniqueName: \"kubernetes.io/projected/fff55b44-4976-4333-bb89-9a157e59dbd8-kube-api-access-mfzhj\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:33.881569 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.881494    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz"]
Jul 21 12:51:33.894864 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.894772    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-chwf8"]
Jul 21 12:51:33.906210 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.901404    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669"]
Jul 21 12:51:33.953943 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.953906    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx"]
Jul 21 12:51:33.960304 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:51:33.960271    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc14403_b3ed_4615_a8a4_ed36a2e38295.slice/crio-aea242fc5c13cbcf84b1e859f0578c3c64749ccb7aff7c75d44ed86b98659be2 WatchSource:0}: Error finding container aea242fc5c13cbcf84b1e859f0578c3c64749ccb7aff7c75d44ed86b98659be2: Status 404 returned error can't find the container with id aea242fc5c13cbcf84b1e859f0578c3c64749ccb7aff7c75d44ed86b98659be2
Jul 21 12:51:33.991666 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.991637    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzwps"]
Jul 21 12:51:33.994505 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:51:33.994480    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec5939d_0f1d_4813_8b9d_aad704d988ed.slice/crio-6b495d40dda31c4ea81817ed8a32fe0f7e53167b9c471d4752f1a7f9d1f79f1c WatchSource:0}: Error finding container 6b495d40dda31c4ea81817ed8a32fe0f7e53167b9c471d4752f1a7f9d1f79f1c: Status 404 returned error can't find the container with id 6b495d40dda31c4ea81817ed8a32fe0f7e53167b9c471d4752f1a7f9d1f79f1c
Jul 21 12:51:33.997353 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:33.997334    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv"]
Jul 21 12:51:34.000080 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:51:34.000062    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df863a6_3d65_4b48_a286_b7c7f8c77bfe.slice/crio-6121e4dc3287789564462c1c87944636cbeb4cd7b663bb64a6c6b28732e2a2c8 WatchSource:0}: Error finding container 6121e4dc3287789564462c1c87944636cbeb4cd7b663bb64a6c6b28732e2a2c8: Status 404 returned error can't find the container with id 6121e4dc3287789564462c1c87944636cbeb4cd7b663bb64a6c6b28732e2a2c8
Jul 21 12:51:34.077355 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.077268    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:34.077496 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.077389    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:34.077496 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.077453    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:51:35.07743393 +0000 UTC m=+40.114463986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:34.178495 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.178459    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:34.178657 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.178616    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:34.178657 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.178636    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:34.178725 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.178691    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:35.178677543 +0000 UTC m=+40.215707596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:34.278894 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.278862    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:34.279054 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.279035    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:34.279129 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:34.279115    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:35.279091984 +0000 UTC m=+40.316122053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:34.539476 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.539445    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzwps" event={"ID":"cec5939d-0f1d-4813-8b9d-aad704d988ed","Type":"ContainerStarted","Data":"6b495d40dda31c4ea81817ed8a32fe0f7e53167b9c471d4752f1a7f9d1f79f1c"}
Jul 21 12:51:34.540896 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.540863    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669" event={"ID":"d069bce7-b06e-4aa0-8302-7425913e90c4","Type":"ContainerStarted","Data":"3de80c9863d465317c19361d8310d66f3c5ae00428932341f2945e6212f2362b"}
Jul 21 12:51:34.542060 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.542038    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" event={"ID":"dc49707d-38d8-4c58-8c98-b65975756230","Type":"ContainerStarted","Data":"ba88bccf82acda8573a9975a36f95306f34a66f0531dc5ae32a8445e3c9cafc0"}
Jul 21 12:51:34.543206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.543180    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv" event={"ID":"6df863a6-3d65-4b48-a286-b7c7f8c77bfe","Type":"ContainerStarted","Data":"6121e4dc3287789564462c1c87944636cbeb4cd7b663bb64a6c6b28732e2a2c8"}
Jul 21 12:51:34.544446 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.544422    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx" event={"ID":"5cc14403-b3ed-4615-a8a4-ed36a2e38295","Type":"ContainerStarted","Data":"aea242fc5c13cbcf84b1e859f0578c3c64749ccb7aff7c75d44ed86b98659be2"}
Jul 21 12:51:34.545605 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:34.545584    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz" event={"ID":"c6da096e-eaf1-43d8-b034-322c491b5af7","Type":"ContainerStarted","Data":"30f475167a717384de5c09bdf31a48965d16d1918dffada5f04919113a499e2e"}
Jul 21 12:51:35.086843 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:35.086793    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:35.087503 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.087012    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:35.087503 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.087080    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:51:37.087061406 +0000 UTC m=+42.124091461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:35.188089 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:35.188047    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:35.188267 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.188225    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:35.188267 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.188247    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:35.188379 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.188315    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:37.188295019 +0000 UTC m=+42.225325092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:35.288838 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:35.288801    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:35.289092 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.289072    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:35.289176 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:35.289142    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:37.289122968 +0000 UTC m=+42.326153024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:37.108053 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:37.108008    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:37.108492 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.108190    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:37.108492 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.108271    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:51:41.108253047 +0000 UTC m=+46.145283102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:37.208638 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:37.208603    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:37.208822 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.208774    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:37.208822 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.208798    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:37.208934 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.208857    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:41.208841012 +0000 UTC m=+46.245871064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:37.309646 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:37.309607    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:37.309846 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.309768    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:37.309846 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:37.309829    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:41.309810545 +0000 UTC m=+46.346840602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:41.143478 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.143296    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:41.143761 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.143446    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:41.143761 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.143572    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:51:49.143557001 +0000 UTC m=+54.180587053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:41.244239 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.244210    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:41.244386 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.244354    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:41.244386 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.244371    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:41.244577 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.244428    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:49.244410129 +0000 UTC m=+54.281440180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:41.345001 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.344764    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:41.345131 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.344909    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:41.345193 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:41.345140    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:51:49.345120321 +0000 UTC m=+54.382150380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:41.570114 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.570078    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669" event={"ID":"d069bce7-b06e-4aa0-8302-7425913e90c4","Type":"ContainerStarted","Data":"259a06ab2e97af06bb9f0ee18b8c2a4c0a9222b7d84157c3b748f779e67fd072"}
Jul 21 12:51:41.571875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.571833    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/0.log"
Jul 21 12:51:41.571998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.571887    2532 generic.go:356] "Generic (PLEG): container finished" podID="dc49707d-38d8-4c58-8c98-b65975756230" containerID="5e975486a54a6b3e3db7783bb40f7a6993a2bea6b07b0438b505645bcde3c0cd" exitCode=255
Jul 21 12:51:41.571998 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.571955    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" event={"ID":"dc49707d-38d8-4c58-8c98-b65975756230","Type":"ContainerDied","Data":"5e975486a54a6b3e3db7783bb40f7a6993a2bea6b07b0438b505645bcde3c0cd"}
Jul 21 12:51:41.572184 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.572170    2532 scope.go:117] "RemoveContainer" containerID="5e975486a54a6b3e3db7783bb40f7a6993a2bea6b07b0438b505645bcde3c0cd"
Jul 21 12:51:41.573926 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.573904    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv" event={"ID":"6df863a6-3d65-4b48-a286-b7c7f8c77bfe","Type":"ContainerStarted","Data":"b53bc83bd223832226de9e7294d53dc224b919a17876ae6aeffe139c4498f286"}
Jul 21 12:51:41.575699 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.575677    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx" event={"ID":"5cc14403-b3ed-4615-a8a4-ed36a2e38295","Type":"ContainerStarted","Data":"c4114d320f0cbe2e5cfa6fbfae774fc38ab61a22d8a2ca9695813600bc4e0d43"}
Jul 21 12:51:41.577257 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.577236    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz" event={"ID":"c6da096e-eaf1-43d8-b034-322c491b5af7","Type":"ContainerStarted","Data":"6eef414f640062117f9e85cf1eafcfb0e0d3764d5be6daf54bcc2d3a55201cf0"}
Jul 21 12:51:41.578803 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.578781    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzwps" event={"ID":"cec5939d-0f1d-4813-8b9d-aad704d988ed","Type":"ContainerStarted","Data":"951d6ec08e941eac66e06ca8427db8a774dc56143302e97547e925be85f18391"}
Jul 21 12:51:41.589460 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.589416    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669" podStartSLOduration=31.391224556 podStartE2EDuration="38.589400319s" totalImagesPullingTime="7.198175763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:41.587429849 +0000 UTC m=+46.624459923" watchObservedRunningTime="2026-07-21 12:51:41.589400319 +0000 UTC m=+46.626430396"
Jul 21 12:51:41.627815 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.627732    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzwps" podStartSLOduration=1.506625209 podStartE2EDuration="8.62771366s" totalImagesPullingTime="7.121088451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:41.627289279 +0000 UTC m=+46.664319355" watchObservedRunningTime="2026-07-21 12:51:41.62771366 +0000 UTC m=+46.664743735"
Jul 21 12:51:41.627934 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.627895    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx" podStartSLOduration=31.472320028 podStartE2EDuration="38.627888319s" totalImagesPullingTime="7.155568291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:41.607214101 +0000 UTC m=+46.644244170" watchObservedRunningTime="2026-07-21 12:51:41.627888319 +0000 UTC m=+46.664918395"
Jul 21 12:51:41.652165 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.652104    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9nkjz" podStartSLOduration=31.435494192 podStartE2EDuration="38.652084803s" totalImagesPullingTime="7.216590611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:41.651780738 +0000 UTC m=+46.688810813" watchObservedRunningTime="2026-07-21 12:51:41.652084803 +0000 UTC m=+46.689114878"
Jul 21 12:51:41.671947 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:41.671344    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wjwsv" podStartSLOduration=16.555033676 podStartE2EDuration="23.67132322s" totalImagesPullingTime="7.116289544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:41.669611269 +0000 UTC m=+46.706641349" watchObservedRunningTime="2026-07-21 12:51:41.67132322 +0000 UTC m=+46.708353294"
Jul 21 12:51:42.455508 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.455458    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"]
Jul 21 12:51:42.478343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.478316    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"]
Jul 21 12:51:42.478476 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.478413    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"
Jul 21 12:51:42.481436 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.481408    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 12:51:42.481565 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.481528    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 12:51:42.481769 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.481749    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ktnph\""
Jul 21 12:51:42.557308 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.557271    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssmlh\" (UniqueName: \"kubernetes.io/projected/2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05-kube-api-access-ssmlh\") pod \"migrator-7cc9c7ffd7-jfb88\" (UID: \"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"
Jul 21 12:51:42.584960 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.584938    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 12:51:42.585386 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.585373    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/0.log"
Jul 21 12:51:42.585448 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.585404    2532 generic.go:356] "Generic (PLEG): container finished" podID="dc49707d-38d8-4c58-8c98-b65975756230" containerID="740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0" exitCode=255
Jul 21 12:51:42.585533 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.585512    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" event={"ID":"dc49707d-38d8-4c58-8c98-b65975756230","Type":"ContainerDied","Data":"740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0"}
Jul 21 12:51:42.585583 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.585574    2532 scope.go:117] "RemoveContainer" containerID="5e975486a54a6b3e3db7783bb40f7a6993a2bea6b07b0438b505645bcde3c0cd"
Jul 21 12:51:42.585716 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.585696    2532 scope.go:117] "RemoveContainer" containerID="740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0"
Jul 21 12:51:42.585900 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:42.585878    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-chwf8_openshift-console-operator(dc49707d-38d8-4c58-8c98-b65975756230)\"" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" podUID="dc49707d-38d8-4c58-8c98-b65975756230"
Jul 21 12:51:42.658931 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.658883    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssmlh\" (UniqueName: \"kubernetes.io/projected/2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05-kube-api-access-ssmlh\") pod \"migrator-7cc9c7ffd7-jfb88\" (UID: \"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"
Jul 21 12:51:42.669721 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.669698    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssmlh\" (UniqueName: \"kubernetes.io/projected/2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05-kube-api-access-ssmlh\") pod \"migrator-7cc9c7ffd7-jfb88\" (UID: \"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"
Jul 21 12:51:42.789591 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.789548    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"
Jul 21 12:51:42.941024 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:42.940872    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88"]
Jul 21 12:51:42.943746 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:51:42.943722    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4673ec_7d93_4ab4_8f7c_e05ca86e6e05.slice/crio-47f8c862791c81a983c5d0a7cfc563ddcbe302fadfd3ecba4be1c50038e8b9e0 WatchSource:0}: Error finding container 47f8c862791c81a983c5d0a7cfc563ddcbe302fadfd3ecba4be1c50038e8b9e0: Status 404 returned error can't find the container with id 47f8c862791c81a983c5d0a7cfc563ddcbe302fadfd3ecba4be1c50038e8b9e0
Jul 21 12:51:43.590623 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:43.590598    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 12:51:43.591035 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:43.590928    2532 scope.go:117] "RemoveContainer" containerID="740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0"
Jul 21 12:51:43.591121 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:43.591100    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-chwf8_openshift-console-operator(dc49707d-38d8-4c58-8c98-b65975756230)\"" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" podUID="dc49707d-38d8-4c58-8c98-b65975756230"
Jul 21 12:51:43.591878 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:43.591858    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88" event={"ID":"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05","Type":"ContainerStarted","Data":"47f8c862791c81a983c5d0a7cfc563ddcbe302fadfd3ecba4be1c50038e8b9e0"}
Jul 21 12:51:43.650840 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:43.650800    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:43.650995 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:43.650884    2532 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:51:44.595089 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:44.595061    2532 scope.go:117] "RemoveContainer" containerID="740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0"
Jul 21 12:51:44.595656 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:44.595281    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-chwf8_openshift-console-operator(dc49707d-38d8-4c58-8c98-b65975756230)\"" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" podUID="dc49707d-38d8-4c58-8c98-b65975756230"
Jul 21 12:51:45.599753 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:45.599719    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88" event={"ID":"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05","Type":"ContainerStarted","Data":"9c249e9ddb50898adc5933aa485280c6fb2f568e5f6203f35ef60406a34e35d4"}
Jul 21 12:51:45.600177 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:45.599769    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88" event={"ID":"2a4673ec-7d93-4ab4-8f7c-e05ca86e6e05","Type":"ContainerStarted","Data":"1df9c4bd2f6fbed6099dffefa86690f45839bf09999d5296b9f3a6778fa28ab7"}
Jul 21 12:51:45.625050 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:45.625007    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jfb88" podStartSLOduration=1.882453487 podStartE2EDuration="3.624993596s" totalImagesPullingTime="1.742540109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:51:45.623420866 +0000 UTC m=+50.660450951" watchObservedRunningTime="2026-07-21 12:51:45.624993596 +0000 UTC m=+50.662023670"
Jul 21 12:51:49.213912 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:49.213876    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:51:49.214450 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.213999    2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 12:51:49.214450 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.214065    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls podName:1a218a93-8fdb-48f7-88c9-da7c098fd7cb nodeName:}" failed. No retries permitted until 2026-07-21 12:52:05.214051446 +0000 UTC m=+70.251081498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2q4jx" (UID: "1a218a93-8fdb-48f7-88c9-da7c098fd7cb") : secret "samples-operator-tls" not found
Jul 21 12:51:49.314648 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:49.314616    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:51:49.314824 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.314803    2532 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 12:51:49.314890 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.314829    2532 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f747789d-xvn7s: secret "image-registry-tls" not found
Jul 21 12:51:49.314941 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.314909    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls podName:25bcf1a2-52c4-497d-8ba4-498652f313f5 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:05.314886002 +0000 UTC m=+70.351916055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls") pod "image-registry-77f747789d-xvn7s" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5") : secret "image-registry-tls" not found
Jul 21 12:51:49.415420 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:49.415394    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:51:49.415536 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.415518    2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 12:51:49.415575 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:51:49.415570    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls podName:fff55b44-4976-4333-bb89-9a157e59dbd8 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:05.415554646 +0000 UTC m=+70.452584698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls") pod "dns-default-rqsdz" (UID: "fff55b44-4976-4333-bb89-9a157e59dbd8") : secret "dns-default-metrics-tls" not found
Jul 21 12:51:58.523918 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:51:58.523886    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sttxk"
Jul 21 12:52:00.352320 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.352292    2532 scope.go:117] "RemoveContainer" containerID="740a7935aa2e6d9cd7000b7f5163a23baa8a7faabca4e47fdc822d4a3cab11f0"
Jul 21 12:52:00.651209 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.651125    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 12:52:00.651342 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.651232    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" event={"ID":"dc49707d-38d8-4c58-8c98-b65975756230","Type":"ContainerStarted","Data":"afd3b23050db898859c96700201b5eb0113cda48a9a9736722e3d975e5452f88"}
Jul 21 12:52:00.651530 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.651503    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:52:00.671337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.671292    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-chwf8" podStartSLOduration=50.486600241 podStartE2EDuration="57.671279124s" totalImagesPullingTime="7.184678883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:00.670843311 +0000 UTC m=+65.707873387" watchObservedRunningTime="2026-07-21 12:52:00.671279124 +0000 UTC m=+65.708309198"
Jul 21 12:52:00.920593 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:00.920535    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-chwf8"
Jul 21 12:52:01.208419 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.208388    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:52:01.208591 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.208442    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:52:01.208591 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.208480    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:52:01.211766 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.211738    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jv2\" (UniqueName: \"kubernetes.io/projected/04f9f338-d8e4-4c89-a516-218939bc2903-kube-api-access-77jv2\") pod \"network-check-target-bbgpn\" (UID: \"04f9f338-d8e4-4c89-a516-218939bc2903\") " pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:52:01.211766 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.211748    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 12:52:01.211916 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.211742    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 12:52:01.221557 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.221538    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d23a16c-adef-4f60-b149-7f12f376512a-original-pull-secret\") pod \"global-pull-secret-syncer-bbcq5\" (UID: \"3d23a16c-adef-4f60-b149-7f12f376512a\") " pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:52:01.221653 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.221569    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba421695-3ee4-4577-901a-a9ca7d9a1159-metrics-certs\") pod \"network-metrics-daemon-gjq2j\" (UID: \"ba421695-3ee4-4577-901a-a9ca7d9a1159\") " pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:52:01.363598 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.363576    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ccp9\""
Jul 21 12:52:01.365655 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.365641    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbcq5"
Jul 21 12:52:01.371411 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.371397    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:52:01.374611 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.374597    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rtsf5\""
Jul 21 12:52:01.382441 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.382426    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gjq2j"
Jul 21 12:52:01.537721 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.537679    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbcq5"]
Jul 21 12:52:01.541517 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:01.541475    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d23a16c_adef_4f60_b149_7f12f376512a.slice/crio-fc6f8c933215f7bd915fec43b68ea9e3bc3d1823568c85eef1b89bf20bd790ff WatchSource:0}: Error finding container fc6f8c933215f7bd915fec43b68ea9e3bc3d1823568c85eef1b89bf20bd790ff: Status 404 returned error can't find the container with id fc6f8c933215f7bd915fec43b68ea9e3bc3d1823568c85eef1b89bf20bd790ff
Jul 21 12:52:01.562596 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.562372    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbgpn"]
Jul 21 12:52:01.564918 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:01.564893    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f9f338_d8e4_4c89_a516_218939bc2903.slice/crio-61c826d3940a94d1bd031f09eb864cec0e4b851fb30a556034e6fe92568f1f3d WatchSource:0}: Error finding container 61c826d3940a94d1bd031f09eb864cec0e4b851fb30a556034e6fe92568f1f3d: Status 404 returned error can't find the container with id 61c826d3940a94d1bd031f09eb864cec0e4b851fb30a556034e6fe92568f1f3d
Jul 21 12:52:01.581792 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.581773    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gjq2j"]
Jul 21 12:52:01.584242 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:01.584224    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba421695_3ee4_4577_901a_a9ca7d9a1159.slice/crio-caf5c10fe4f4c3899e0d6af7c461c59269a32fd3d67ad23eafec77c728d0501c WatchSource:0}: Error finding container caf5c10fe4f4c3899e0d6af7c461c59269a32fd3d67ad23eafec77c728d0501c: Status 404 returned error can't find the container with id caf5c10fe4f4c3899e0d6af7c461c59269a32fd3d67ad23eafec77c728d0501c
Jul 21 12:52:01.655607 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.655574    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gjq2j" event={"ID":"ba421695-3ee4-4577-901a-a9ca7d9a1159","Type":"ContainerStarted","Data":"caf5c10fe4f4c3899e0d6af7c461c59269a32fd3d67ad23eafec77c728d0501c"}
Jul 21 12:52:01.657032 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.657009    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbgpn" event={"ID":"04f9f338-d8e4-4c89-a516-218939bc2903","Type":"ContainerStarted","Data":"9e06795af241fa1e51e25aad33a02452f06e0825edcc2f7a791b17b8e041e0bb"}
Jul 21 12:52:01.657135 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.657050    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbgpn" event={"ID":"04f9f338-d8e4-4c89-a516-218939bc2903","Type":"ContainerStarted","Data":"61c826d3940a94d1bd031f09eb864cec0e4b851fb30a556034e6fe92568f1f3d"}
Jul 21 12:52:01.657135 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.657096    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:52:01.658209 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.658187    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbcq5" event={"ID":"3d23a16c-adef-4f60-b149-7f12f376512a","Type":"ContainerStarted","Data":"fc6f8c933215f7bd915fec43b68ea9e3bc3d1823568c85eef1b89bf20bd790ff"}
Jul 21 12:52:01.677740 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:01.677696    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bbgpn" podStartSLOduration=66.677682594 podStartE2EDuration="1m6.677682594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:01.67651842 +0000 UTC m=+66.713548495" watchObservedRunningTime="2026-07-21 12:52:01.677682594 +0000 UTC m=+66.714712667"
Jul 21 12:52:03.668489 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:03.668455    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gjq2j" event={"ID":"ba421695-3ee4-4577-901a-a9ca7d9a1159","Type":"ContainerStarted","Data":"65ed490605d33e7902ebd30710096520e903dedfff5173afca09bd894a6f380a"}
Jul 21 12:52:03.668923 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:03.668513    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gjq2j" event={"ID":"ba421695-3ee4-4577-901a-a9ca7d9a1159","Type":"ContainerStarted","Data":"6c47f5d8cc1bb0101327a0db6371aa2848b2bca0785b2ebb36f3dccd80974d9b"}
Jul 21 12:52:03.686349 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:03.686298    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gjq2j" podStartSLOduration=66.505344561 podStartE2EDuration="1m7.686278615s" totalImagesPullingTime="1.180934054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:03.685762622 +0000 UTC m=+68.722792698" watchObservedRunningTime="2026-07-21 12:52:03.686278615 +0000 UTC m=+68.723308685"
Jul 21 12:52:05.241008 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.240961    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:52:05.244003 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.243977    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a218a93-8fdb-48f7-88c9-da7c098fd7cb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2q4jx\" (UID: \"1a218a93-8fdb-48f7-88c9-da7c098fd7cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:52:05.341651 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.341617    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:05.344489 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.344456    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"image-registry-77f747789d-xvn7s\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") " pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:05.442106 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.442067    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:52:05.444744 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.444713    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fff55b44-4976-4333-bb89-9a157e59dbd8-metrics-tls\") pod \"dns-default-rqsdz\" (UID: \"fff55b44-4976-4333-bb89-9a157e59dbd8\") " pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:52:05.490661 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.490636    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x22rq\""
Jul 21 12:52:05.498182 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.498115    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"
Jul 21 12:52:05.537669 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.537645    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjwbz\""
Jul 21 12:52:05.545237 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.545218    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:05.603644 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.603616    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kcsl4\""
Jul 21 12:52:05.611320 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.611294    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:52:05.981386 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.981353    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:52:05.986608 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:05.986574    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bcf1a2_52c4_497d_8ba4_498652f313f5.slice/crio-21ea2d83b6a9526a23eb25e523859a698069f1b72cc6d5cfcba2700548102da2 WatchSource:0}: Error finding container 21ea2d83b6a9526a23eb25e523859a698069f1b72cc6d5cfcba2700548102da2: Status 404 returned error can't find the container with id 21ea2d83b6a9526a23eb25e523859a698069f1b72cc6d5cfcba2700548102da2
Jul 21 12:52:05.995423 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:05.995397    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqsdz"]
Jul 21 12:52:05.999245 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:05.999218    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff55b44_4976_4333_bb89_9a157e59dbd8.slice/crio-fd3e157747be4497706205027a5ea2a942cce7eedc548a74e20d748e384bed3a WatchSource:0}: Error finding container fd3e157747be4497706205027a5ea2a942cce7eedc548a74e20d748e384bed3a: Status 404 returned error can't find the container with id fd3e157747be4497706205027a5ea2a942cce7eedc548a74e20d748e384bed3a
Jul 21 12:52:06.008910 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.008857    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx"]
Jul 21 12:52:06.683448 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.683407    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqsdz" event={"ID":"fff55b44-4976-4333-bb89-9a157e59dbd8","Type":"ContainerStarted","Data":"fd3e157747be4497706205027a5ea2a942cce7eedc548a74e20d748e384bed3a"}
Jul 21 12:52:06.685206 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.685176    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" event={"ID":"25bcf1a2-52c4-497d-8ba4-498652f313f5","Type":"ContainerStarted","Data":"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"}
Jul 21 12:52:06.685337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.685223    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" event={"ID":"25bcf1a2-52c4-497d-8ba4-498652f313f5","Type":"ContainerStarted","Data":"21ea2d83b6a9526a23eb25e523859a698069f1b72cc6d5cfcba2700548102da2"}
Jul 21 12:52:06.685337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.685298    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:06.687374 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.687348    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbcq5" event={"ID":"3d23a16c-adef-4f60-b149-7f12f376512a","Type":"ContainerStarted","Data":"71cd607ee169201e9f248f7c74f8b624db414220a2f8ab69a4b8f5635a1eb881"}
Jul 21 12:52:06.689592 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.689555    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx" event={"ID":"1a218a93-8fdb-48f7-88c9-da7c098fd7cb","Type":"ContainerStarted","Data":"93276af671ccac27ef459b03a44ae92d3b8445a39cec165d1f76c0bef8c47901"}
Jul 21 12:52:06.709120 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.709055    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" podStartSLOduration=57.709033309 podStartE2EDuration="57.709033309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:06.708993183 +0000 UTC m=+71.746023260" watchObservedRunningTime="2026-07-21 12:52:06.709033309 +0000 UTC m=+71.746063387"
Jul 21 12:52:06.725767 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.725703    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bbcq5" podStartSLOduration=66.399516061 podStartE2EDuration="1m10.725679917s" totalImagesPullingTime="4.326163856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:06.724270757 +0000 UTC m=+71.761300856" watchObservedRunningTime="2026-07-21 12:52:06.725679917 +0000 UTC m=+71.762709994"
Jul 21 12:52:06.974091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.974047    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"]
Jul 21 12:52:06.978628 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.978221    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:06.981258 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981224    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 12:52:06.981502 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981481    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 12:52:06.981684 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981602    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 12:52:06.982091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981879    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 12:52:06.982091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981884    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 12:52:06.982091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981991    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 12:52:06.982091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.981944    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 12:52:06.990544 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:06.990488    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"]
Jul 21 12:52:07.058623 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058587    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.058797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058631    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pp8w\" (UniqueName: \"kubernetes.io/projected/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-kube-api-access-8pp8w\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.058797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058662    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.058797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058681    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.058797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058730    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.058797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.058746    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159358 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159325    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159546 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159368    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pp8w\" (UniqueName: \"kubernetes.io/projected/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-kube-api-access-8pp8w\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159546 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159393    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159546 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159418    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159546 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159443    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.159546 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.159459    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.160198 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.160146    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.162359 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.162337    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.162492 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.162392    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.162765 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.162743    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-ca\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.163073 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.163058    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.168901 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.168882    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pp8w\" (UniqueName: \"kubernetes.io/projected/2b8578ab-e1c2-4ea0-aab0-a637e7e45af2-kube-api-access-8pp8w\") pod \"cluster-proxy-proxy-agent-84b4578cd7-9hkgz\" (UID: \"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:07.303105 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:07.303024    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"
Jul 21 12:52:08.747551 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:08.747527    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz"]
Jul 21 12:52:08.751242 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:08.751205    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b8578ab_e1c2_4ea0_aab0_a637e7e45af2.slice/crio-94e6b94476835ecc63c87a68c490523ebae8978436b9ee77c09a45c727ea0bd9 WatchSource:0}: Error finding container 94e6b94476835ecc63c87a68c490523ebae8978436b9ee77c09a45c727ea0bd9: Status 404 returned error can't find the container with id 94e6b94476835ecc63c87a68c490523ebae8978436b9ee77c09a45c727ea0bd9
Jul 21 12:52:09.702743 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.702702    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqsdz" event={"ID":"fff55b44-4976-4333-bb89-9a157e59dbd8","Type":"ContainerStarted","Data":"97c3b2148e0cbcf47a41abbe26000ca2d3f5cbe88bbe8fc01872587f3c810407"}
Jul 21 12:52:09.702916 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.702765    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqsdz" event={"ID":"fff55b44-4976-4333-bb89-9a157e59dbd8","Type":"ContainerStarted","Data":"b967abd5281b6db27d757cb30f3d9b434278884c63821f50fb8cff2c9075c652"}
Jul 21 12:52:09.702916 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.702795    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:52:09.704424 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.704398    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx" event={"ID":"1a218a93-8fdb-48f7-88c9-da7c098fd7cb","Type":"ContainerStarted","Data":"578ad7bb141ec4937c8856e4fc1705ff7de45dcce490dc2955c447b9536357b6"}
Jul 21 12:52:09.704530 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.704438    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx" event={"ID":"1a218a93-8fdb-48f7-88c9-da7c098fd7cb","Type":"ContainerStarted","Data":"75edbf30ff49c6f4c56b71a2cb918ebee23444d0ccefffe422813b10a24ef8f3"}
Jul 21 12:52:09.705429 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.705409    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz" event={"ID":"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2","Type":"ContainerStarted","Data":"94e6b94476835ecc63c87a68c490523ebae8978436b9ee77c09a45c727ea0bd9"}
Jul 21 12:52:09.721765 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.721726    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rqsdz" podStartSLOduration=34.141720686 podStartE2EDuration="36.721710343s" totalImagesPullingTime="2.579989657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:09.720845494 +0000 UTC m=+74.757875568" watchObservedRunningTime="2026-07-21 12:52:09.721710343 +0000 UTC m=+74.758740418"
Jul 21 12:52:09.740528 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:09.740464    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2q4jx" podStartSLOduration=64.210269835 podStartE2EDuration="1m6.740450478s" totalImagesPullingTime="2.530180643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:09.738493874 +0000 UTC m=+74.775523950" watchObservedRunningTime="2026-07-21 12:52:09.740450478 +0000 UTC m=+74.777480552"
Jul 21 12:52:13.722658 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:13.722618    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz" event={"ID":"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2","Type":"ContainerStarted","Data":"8ebdc39c3bbeb4e5888495d8e02e3945b881ec1bba71d44d7ac6e4a5444c39ea"}
Jul 21 12:52:13.723018 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:13.722672    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz" event={"ID":"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2","Type":"ContainerStarted","Data":"6207fec0bf6dff59cc6a78c413fba02d6f0d180501dc5fe458f2da7dca1d0198"}
Jul 21 12:52:13.723018 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:13.722689    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz" event={"ID":"2b8578ab-e1c2-4ea0-aab0-a637e7e45af2","Type":"ContainerStarted","Data":"fad28364f5236c55640a3f9702c39b126afdaed0251586cd7581a2590b7bc6b9"}
Jul 21 12:52:13.749554 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:13.749509    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b4578cd7-9hkgz" podStartSLOduration=3.785144342 podStartE2EDuration="7.749493081s" totalImagesPullingTime="3.964348739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:13.748714931 +0000 UTC m=+78.785745018" watchObservedRunningTime="2026-07-21 12:52:13.749493081 +0000 UTC m=+78.786523154"
Jul 21 12:52:14.144088 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.144012    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2wsv9"]
Jul 21 12:52:14.147423 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.147405    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.150175 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.150120    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 12:52:14.150357 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.150344    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 12:52:14.150454 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.150437    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 12:52:14.150523 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.150508    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 12:52:14.150674 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.150658    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzpc5\""
Jul 21 12:52:14.157685 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.157665    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wsv9"]
Jul 21 12:52:14.218992 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.218968    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pknw4\" (UniqueName: \"kubernetes.io/projected/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-api-access-pknw4\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.219128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.219012    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1e2282-8f1e-4712-af97-76e60a5cc93f-data-volume\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.219128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.219048    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.219128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.219115    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1e2282-8f1e-4712-af97-76e60a5cc93f-crio-socket\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.219333 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.219147    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320005    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pknw4\" (UniqueName: \"kubernetes.io/projected/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-api-access-pknw4\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320044 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320054    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1e2282-8f1e-4712-af97-76e60a5cc93f-data-volume\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320080    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320104    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1e2282-8f1e-4712-af97-76e60a5cc93f-crio-socket\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320132    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.320185    2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.320258    2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.320292 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320268    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1e2282-8f1e-4712-af97-76e60a5cc93f-crio-socket\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.320528 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.320261    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:14.820245138 +0000 UTC m=+79.857275189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.320528 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.320334    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:14.820315442 +0000 UTC m=+79.857345501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.320528 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.320409    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1e2282-8f1e-4712-af97-76e60a5cc93f-data-volume\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.329200 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.329183    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pknw4\" (UniqueName: \"kubernetes.io/projected/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-api-access-pknw4\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.822978 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.822945    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.823429 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:14.823028    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:14.823429 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.823085    2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.823429 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.823197    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:15.823174235 +0000 UTC m=+80.860204307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:14.823429 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.823215    2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:14.823429 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:14.823291    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:15.823273883 +0000 UTC m=+80.860303936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:15.228667 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:15.228642    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqsdz_fff55b44-4976-4333-bb89-9a157e59dbd8/dns/0.log"
Jul 21 12:52:15.413739 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:15.413717    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqsdz_fff55b44-4976-4333-bb89-9a157e59dbd8/kube-rbac-proxy/0.log"
Jul 21 12:52:15.831975 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:15.831943    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:15.832410 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:15.831993    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:15.832410 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:15.832070    2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:15.832410 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:15.832094    2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:15.832410 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:15.832135    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:17.832117828 +0000 UTC m=+82.869147881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:15.832410 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:15.832166    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:17.832142463 +0000 UTC m=+82.869172515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:16.213454 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:16.213428    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfzld_a5840726-f0a2-417d-912c-ffd43de49f34/dns-node-resolver/0.log"
Jul 21 12:52:16.812670 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:16.812642    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77f747789d-xvn7s_25bcf1a2-52c4-497d-8ba4-498652f313f5/registry/0.log"
Jul 21 12:52:17.013854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:17.013827    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pdg7_9db14508-9239-4159-b728-f007e86e54ef/node-ca/0.log"
Jul 21 12:52:17.845781 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:17.845745    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:17.845961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:17.845804    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:17.845961 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:17.845867    2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:17.845961 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:17.845911    2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:17.845961 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:17.845932    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:21.845915842 +0000 UTC m=+86.882945895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:17.845961 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:17.845964    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:21.845950925 +0000 UTC m=+86.882980983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:18.213938 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:18.213909    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzwps_cec5939d-0f1d-4813-8b9d-aad704d988ed/serve-healthcheck-canary/0.log"
Jul 21 12:52:19.711069 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:19.711035    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rqsdz"
Jul 21 12:52:21.879854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:21.879813    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:21.880277 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:21.879869    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:21.880277 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:21.879932    2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 12:52:21.880277 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:21.879976    2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:21.880277 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:21.880006    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:29.87999071 +0000 UTC m=+94.917020766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : configmap "kube-rbac-proxy" not found
Jul 21 12:52:21.880277 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:21.880023    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls podName:dd1e2282-8f1e-4712-af97-76e60a5cc93f nodeName:}" failed. No retries permitted until 2026-07-21 12:52:29.880012012 +0000 UTC m=+94.917042064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wsv9" (UID: "dd1e2282-8f1e-4712-af97-76e60a5cc93f") : secret "insights-runtime-extractor-tls" not found
Jul 21 12:52:24.282442 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.282410    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xq7wk"]
Jul 21 12:52:24.287770 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.287753    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.290566 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.290544    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 12:52:24.290739 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.290721    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 12:52:24.290816 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.290736    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjmwx\""
Jul 21 12:52:24.291957 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.291929    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 12:52:24.292033 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.291967    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 12:52:24.292033 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.291977    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 12:52:24.292033 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.292005    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 12:52:24.400269 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400239    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-textfile\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400278    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400299    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-wtmp\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400406 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400314    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpjgj\" (UniqueName: \"kubernetes.io/projected/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-kube-api-access-vpjgj\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400575 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400413    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-sys\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400575 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400458    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-metrics-client-ca\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400575 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400488    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400712 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400574    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-root\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.400712 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.400617    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501049 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501022    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-root\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501049 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501054    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501117    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-textfile\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501134    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-root\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501140    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501210    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-wtmp\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501226    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpjgj\" (UniqueName: \"kubernetes.io/projected/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-kube-api-access-vpjgj\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:24.501239    2532 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 12:52:24.501268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501247    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-sys\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501272    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-metrics-client-ca\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:24.501304    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls podName:5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6 nodeName:}" failed. No retries permitted until 2026-07-21 12:52:25.001288313 +0000 UTC m=+90.038318371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls") pod "node-exporter-xq7wk" (UID: "5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6") : secret "node-exporter-tls" not found
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501319    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501347    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-sys\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501386    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-wtmp\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501595 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501514    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-textfile\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501842 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501829    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.501889 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.501860    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-metrics-client-ca\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.503799 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.503774    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:24.513173 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:24.513137    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpjgj\" (UniqueName: \"kubernetes.io/projected/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-kube-api-access-vpjgj\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:25.006474 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:25.006435    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:25.009076 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:25.009053    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6-node-exporter-tls\") pod \"node-exporter-xq7wk\" (UID: \"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6\") " pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:25.200745 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:25.200717    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xq7wk"
Jul 21 12:52:25.214578 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:25.214525    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5058d464_fd5d_4e9f_8b0e_3cec0ab3f9d6.slice/crio-57f50d0be337c036ab4100f71891ded9bbee2df1eee525e009d3e22532bf4b2f WatchSource:0}: Error finding container 57f50d0be337c036ab4100f71891ded9bbee2df1eee525e009d3e22532bf4b2f: Status 404 returned error can't find the container with id 57f50d0be337c036ab4100f71891ded9bbee2df1eee525e009d3e22532bf4b2f
Jul 21 12:52:25.765232 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:25.765202    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xq7wk" event={"ID":"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6","Type":"ContainerStarted","Data":"57f50d0be337c036ab4100f71891ded9bbee2df1eee525e009d3e22532bf4b2f"}
Jul 21 12:52:26.770990 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:26.770956    2532 generic.go:356] "Generic (PLEG): container finished" podID="5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6" containerID="0f663cf18f5fe070347f191535bb6bfeb1da89db807a8a3b39966961b8783622" exitCode=0
Jul 21 12:52:26.771521 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:26.771021    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xq7wk" event={"ID":"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6","Type":"ContainerDied","Data":"0f663cf18f5fe070347f191535bb6bfeb1da89db807a8a3b39966961b8783622"}
Jul 21 12:52:27.697064 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:27.697037    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:27.776434 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:27.776403    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xq7wk" event={"ID":"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6","Type":"ContainerStarted","Data":"13bfaaab8c3cd15e70609dd96d771d8208490df97fbef5e499f3f0e177df1443"}
Jul 21 12:52:27.776764 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:27.776458    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xq7wk" event={"ID":"5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6","Type":"ContainerStarted","Data":"ce517a772a1bbf832fc44f1900323405b808ad42354cbea84a47971513ab1a7e"}
Jul 21 12:52:27.804901 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:27.804860    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xq7wk" podStartSLOduration=2.664528345 podStartE2EDuration="3.804844469s" totalImagesPullingTime="1.070688906s" totalInitContainerRuntime="69.627218ms" isStatefulPod=true podCreationTimestamp="2026-07-21 12:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:27.804437364 +0000 UTC m=+92.841467439" watchObservedRunningTime="2026-07-21 12:52:27.804844469 +0000 UTC m=+92.841874542"
Jul 21 12:52:29.945225 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:29.945180    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:29.945611 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:29.945284    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:29.945859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:29.945837    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1e2282-8f1e-4712-af97-76e60a5cc93f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:29.947725 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:29.947704    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1e2282-8f1e-4712-af97-76e60a5cc93f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wsv9\" (UID: \"dd1e2282-8f1e-4712-af97-76e60a5cc93f\") " pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:30.055992 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:30.055944    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wsv9"
Jul 21 12:52:30.186973 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:30.186944    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wsv9"]
Jul 21 12:52:30.189234 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:52:30.189195    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1e2282_8f1e_4712_af97_76e60a5cc93f.slice/crio-d0c6bf32ae40b159219410c52ccf9aa0557c18951d754cd2864689004a6460e0 WatchSource:0}: Error finding container d0c6bf32ae40b159219410c52ccf9aa0557c18951d754cd2864689004a6460e0: Status 404 returned error can't find the container with id d0c6bf32ae40b159219410c52ccf9aa0557c18951d754cd2864689004a6460e0
Jul 21 12:52:30.792437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:30.792399    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wsv9" event={"ID":"dd1e2282-8f1e-4712-af97-76e60a5cc93f","Type":"ContainerStarted","Data":"d0c6bf32ae40b159219410c52ccf9aa0557c18951d754cd2864689004a6460e0"}
Jul 21 12:52:31.358329 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:31.358297    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:52:32.665087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:32.665057    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bbgpn"
Jul 21 12:52:35.822619 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:35.822577    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wsv9" event={"ID":"dd1e2282-8f1e-4712-af97-76e60a5cc93f","Type":"ContainerStarted","Data":"1160603da11f6e5ab1450be90b15b5d6208ad63da40e16413814367247d28d14"}
Jul 21 12:52:38.837792 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:38.837761    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wsv9" event={"ID":"dd1e2282-8f1e-4712-af97-76e60a5cc93f","Type":"ContainerStarted","Data":"eb2fbe08248d19e772727eff03b25d54a6639033b87888bf1fc4406d8acd34f3"}
Jul 21 12:52:43.857055 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:43.857012    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wsv9" event={"ID":"dd1e2282-8f1e-4712-af97-76e60a5cc93f","Type":"ContainerStarted","Data":"80e5585acca56feeb207e862a64a2ce4d61c45fe730ff072d36a130dc6db05e2"}
Jul 21 12:52:43.876921 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:43.876469    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2wsv9" podStartSLOduration=17.436453606 podStartE2EDuration="29.876449847s" totalImagesPullingTime="12.439996241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 12:52:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:52:43.875914219 +0000 UTC m=+108.912944307" watchObservedRunningTime="2026-07-21 12:52:43.876449847 +0000 UTC m=+108.913479922"
Jul 21 12:52:51.886218 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:51.886185    2532 generic.go:356] "Generic (PLEG): container finished" podID="5cc14403-b3ed-4615-a8a4-ed36a2e38295" containerID="c4114d320f0cbe2e5cfa6fbfae774fc38ab61a22d8a2ca9695813600bc4e0d43" exitCode=0
Jul 21 12:52:51.886600 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:51.886257    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx" event={"ID":"5cc14403-b3ed-4615-a8a4-ed36a2e38295","Type":"ContainerDied","Data":"c4114d320f0cbe2e5cfa6fbfae774fc38ab61a22d8a2ca9695813600bc4e0d43"}
Jul 21 12:52:51.886600 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:51.886575    2532 scope.go:117] "RemoveContainer" containerID="c4114d320f0cbe2e5cfa6fbfae774fc38ab61a22d8a2ca9695813600bc4e0d43"
Jul 21 12:52:52.891619 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:52.891582    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-s5wwx" event={"ID":"5cc14403-b3ed-4615-a8a4-ed36a2e38295","Type":"ContainerStarted","Data":"111eb5a43fd839b3e67590029a1d320b068467b12f9d2decdab81204ccd106a2"}
Jul 21 12:52:56.385119 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.385058    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" podUID="25bcf1a2-52c4-497d-8ba4-498652f313f5" containerName="registry" containerID="cri-o://e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747" gracePeriod=30
Jul 21 12:52:56.623253 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.623232    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:56.648286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648233    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648269    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648431 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648301    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648431 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648359    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648431 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648399    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47tvc\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648431 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648422    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648621 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648452    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648621 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648485    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets\") pod \"25bcf1a2-52c4-497d-8ba4-498652f313f5\" (UID: \"25bcf1a2-52c4-497d-8ba4-498652f313f5\") "
Jul 21 12:52:56.648726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648699    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:52:56.648832 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.648811    2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-trusted-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.650361 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.650325    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:52:56.651966 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.651913    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:52:56.652097 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.651973    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:52:56.652097 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.652044    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:52:56.652229 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.652108    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:52:56.652792 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.652757    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc" (OuterVolumeSpecName: "kube-api-access-47tvc") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "kube-api-access-47tvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:52:56.661353 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.661326    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25bcf1a2-52c4-497d-8ba4-498652f313f5" (UID: "25bcf1a2-52c4-497d-8ba4-498652f313f5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:52:56.749398 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749375    2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749398 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749396    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47tvc\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-kube-api-access-47tvc\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749406    2532 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25bcf1a2-52c4-497d-8ba4-498652f313f5-registry-certificates\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749415    2532 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-image-registry-private-configuration\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749425    2532 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25bcf1a2-52c4-497d-8ba4-498652f313f5-installation-pull-secrets\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749433    2532 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25bcf1a2-52c4-497d-8ba4-498652f313f5-bound-sa-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.749512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.749441    2532 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25bcf1a2-52c4-497d-8ba4-498652f313f5-ca-trust-extracted\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:52:56.905834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.905752    2532 generic.go:356] "Generic (PLEG): container finished" podID="25bcf1a2-52c4-497d-8ba4-498652f313f5" containerID="e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747" exitCode=0
Jul 21 12:52:56.905834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.905797    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f747789d-xvn7s"
Jul 21 12:52:56.905834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.905813    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" event={"ID":"25bcf1a2-52c4-497d-8ba4-498652f313f5","Type":"ContainerDied","Data":"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"}
Jul 21 12:52:56.906087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.905864    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f747789d-xvn7s" event={"ID":"25bcf1a2-52c4-497d-8ba4-498652f313f5","Type":"ContainerDied","Data":"21ea2d83b6a9526a23eb25e523859a698069f1b72cc6d5cfcba2700548102da2"}
Jul 21 12:52:56.906087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.905888    2532 scope.go:117] "RemoveContainer" containerID="e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"
Jul 21 12:52:56.914121 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.914104    2532 scope.go:117] "RemoveContainer" containerID="e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"
Jul 21 12:52:56.916574 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:52:56.916544    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747\": container with ID starting with e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747 not found: ID does not exist" containerID="e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"
Jul 21 12:52:56.916674 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.916584    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747"} err="failed to get container status \"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747\": rpc error: code = NotFound desc = could not find container \"e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747\": container with ID starting with e0cccd897840ad13878688714ea2e25fe55136e6ad75936c3b489c92ce3cc747 not found: ID does not exist"
Jul 21 12:52:56.927266 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.927235    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:52:56.930655 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:56.930632    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77f747789d-xvn7s"]
Jul 21 12:52:57.361432 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:52:57.361399    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25bcf1a2-52c4-497d-8ba4-498652f313f5" path="/var/lib/kubelet/pods/25bcf1a2-52c4-497d-8ba4-498652f313f5/volumes"
Jul 21 12:53:17.977147 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:53:17.977113    2532 generic.go:356] "Generic (PLEG): container finished" podID="d069bce7-b06e-4aa0-8302-7425913e90c4" containerID="259a06ab2e97af06bb9f0ee18b8c2a4c0a9222b7d84157c3b748f779e67fd072" exitCode=0
Jul 21 12:53:17.977564 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:53:17.977174    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669" event={"ID":"d069bce7-b06e-4aa0-8302-7425913e90c4","Type":"ContainerDied","Data":"259a06ab2e97af06bb9f0ee18b8c2a4c0a9222b7d84157c3b748f779e67fd072"}
Jul 21 12:53:17.977564 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:53:17.977446    2532 scope.go:117] "RemoveContainer" containerID="259a06ab2e97af06bb9f0ee18b8c2a4c0a9222b7d84157c3b748f779e67fd072"
Jul 21 12:53:18.981816 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:53:18.981784    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7q669" event={"ID":"d069bce7-b06e-4aa0-8302-7425913e90c4","Type":"ContainerStarted","Data":"5fe002f7230e95d9a09d6ff683a82f01b8237b635c91e3d561303efab8d331ee"}
Jul 21 12:54:27.274787 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.274756    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"]
Jul 21 12:54:27.275268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.275034    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25bcf1a2-52c4-497d-8ba4-498652f313f5" containerName="registry"
Jul 21 12:54:27.275268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.275045    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25bcf1a2-52c4-497d-8ba4-498652f313f5" containerName="registry"
Jul 21 12:54:27.275268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.275115    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25bcf1a2-52c4-497d-8ba4-498652f313f5" containerName="registry"
Jul 21 12:54:27.278129 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.278113    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.282356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.282332    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 12:54:27.282468 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.282357    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 12:54:27.283717 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.283695    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gwfgb\""
Jul 21 12:54:27.288000 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.287980    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"]
Jul 21 12:54:27.298321 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.298303    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.298418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.298351    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbzcc\" (UniqueName: \"kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.298418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.298374    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.398717 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.398695    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbzcc\" (UniqueName: \"kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.398854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.398723    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.398854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.398812    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.399148 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.399127    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.399242 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.399234    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.407971 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.407946    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbzcc\" (UniqueName: \"kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.587353 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.587280    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:27.715667 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:27.715557    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"]
Jul 21 12:54:27.717823 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:54:27.717797    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca20c960_72f8_4ef9_a06b_1cab0fcaaa0f.slice/crio-8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a WatchSource:0}: Error finding container 8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a: Status 404 returned error can't find the container with id 8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a
Jul 21 12:54:28.223444 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:28.223412    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc" event={"ID":"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f","Type":"ContainerStarted","Data":"8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a"}
Jul 21 12:54:34.252435 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:34.252400    2532 generic.go:356] "Generic (PLEG): container finished" podID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerID="13249e3ca896d646416682df175e1f1c11f0dc6e7cc05ad498f6877a37514b64" exitCode=0
Jul 21 12:54:34.252930 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:34.252445    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc" event={"ID":"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f","Type":"ContainerDied","Data":"13249e3ca896d646416682df175e1f1c11f0dc6e7cc05ad498f6877a37514b64"}
Jul 21 12:54:36.261880 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:36.261843    2532 generic.go:356] "Generic (PLEG): container finished" podID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerID="c145822d58e8f16a53e3d88b3d0ec060c9d3ae632a82232d02d2db6692fa5038" exitCode=0
Jul 21 12:54:36.262209 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:36.261923    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc" event={"ID":"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f","Type":"ContainerDied","Data":"c145822d58e8f16a53e3d88b3d0ec060c9d3ae632a82232d02d2db6692fa5038"}
Jul 21 12:54:43.291681 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:43.291640    2532 generic.go:356] "Generic (PLEG): container finished" podID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerID="f588df01e5067492b2aba299026b84590a26fbea69580d8b5aa6df9ad3666238" exitCode=0
Jul 21 12:54:43.292083 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:43.291720    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc" event={"ID":"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f","Type":"ContainerDied","Data":"f588df01e5067492b2aba299026b84590a26fbea69580d8b5aa6df9ad3666238"}
Jul 21 12:54:44.430397 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.430376    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:44.534537 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.534503    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle\") pod \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") "
Jul 21 12:54:44.534685 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.534583    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbzcc\" (UniqueName: \"kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc\") pod \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") "
Jul 21 12:54:44.534685 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.534604    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util\") pod \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\" (UID: \"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f\") "
Jul 21 12:54:44.535145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.535121    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle" (OuterVolumeSpecName: "bundle") pod "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" (UID: "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:54:44.536902 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.536880    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc" (OuterVolumeSpecName: "kube-api-access-bbzcc") pod "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" (UID: "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f"). InnerVolumeSpecName "kube-api-access-bbzcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:54:44.538858 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.538840    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util" (OuterVolumeSpecName: "util") pod "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" (UID: "ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:54:44.635286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.635201    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbzcc\" (UniqueName: \"kubernetes.io/projected/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-kube-api-access-bbzcc\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:54:44.635286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.635231    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:54:44.635286 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:44.635240    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:54:45.301587 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:45.301554    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc" event={"ID":"ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f","Type":"ContainerDied","Data":"8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a"}
Jul 21 12:54:45.301587 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:45.301584    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540djncc"
Jul 21 12:54:45.301855 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:45.301598    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e51490b7e21d84ee165b7f07141a5e117504d6c109d06a786d1f9ab33c1c63a"
Jul 21 12:54:50.383357 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383330    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"]
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383569    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="util"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383581    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="util"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383590    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="pull"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383595    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="pull"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383604    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="extract"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383609    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="extract"
Jul 21 12:54:50.383762 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.383662    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca20c960-72f8-4ef9-a06b-1cab0fcaaa0f" containerName="extract"
Jul 21 12:54:50.386356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.386340    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.389884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.389860    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d75vk\""
Jul 21 12:54:50.390018 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.389958    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 12:54:50.390658 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.390641    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:54:50.457341 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.457313    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"]
Jul 21 12:54:50.478195 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.478167    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88a87f30-9f0d-4319-ac59-93ff0111b2b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.478351 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.478218    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7r8\" (UniqueName: \"kubernetes.io/projected/88a87f30-9f0d-4319-ac59-93ff0111b2b3-kube-api-access-hl7r8\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.579000 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.578964    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88a87f30-9f0d-4319-ac59-93ff0111b2b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.579170 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.579024    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7r8\" (UniqueName: \"kubernetes.io/projected/88a87f30-9f0d-4319-ac59-93ff0111b2b3-kube-api-access-hl7r8\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.579382 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.579364    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88a87f30-9f0d-4319-ac59-93ff0111b2b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.588367 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.588344    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7r8\" (UniqueName: \"kubernetes.io/projected/88a87f30-9f0d-4319-ac59-93ff0111b2b3-kube-api-access-hl7r8\") pod \"cert-manager-operator-controller-manager-55c444bf86-shtq9\" (UID: \"88a87f30-9f0d-4319-ac59-93ff0111b2b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.694917 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.694891    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"
Jul 21 12:54:50.846844 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:50.846823    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9"]
Jul 21 12:54:50.849607 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:54:50.849575    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a87f30_9f0d_4319_ac59_93ff0111b2b3.slice/crio-688c31130edf92d8297ea663e1453c86e880c9ef5ae2ddda602ed9ce3c7ec847 WatchSource:0}: Error finding container 688c31130edf92d8297ea663e1453c86e880c9ef5ae2ddda602ed9ce3c7ec847: Status 404 returned error can't find the container with id 688c31130edf92d8297ea663e1453c86e880c9ef5ae2ddda602ed9ce3c7ec847
Jul 21 12:54:51.324010 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:51.323971    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9" event={"ID":"88a87f30-9f0d-4319-ac59-93ff0111b2b3","Type":"ContainerStarted","Data":"688c31130edf92d8297ea663e1453c86e880c9ef5ae2ddda602ed9ce3c7ec847"}
Jul 21 12:54:53.335341 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:53.335302    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9" event={"ID":"88a87f30-9f0d-4319-ac59-93ff0111b2b3","Type":"ContainerStarted","Data":"f28e8fe60405ebd52010d170403e2de65a7e08e1deb41e886262a44c9927466b"}
Jul 21 12:54:53.368764 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:53.368716    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-shtq9" podStartSLOduration=1.4584298150000001 podStartE2EDuration="3.368700181s" totalImagesPullingTime="1.910270366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:54:53.36665066 +0000 UTC m=+238.403680774" watchObservedRunningTime="2026-07-21 12:54:53.368700181 +0000 UTC m=+238.405730255"
Jul 21 12:54:58.649470 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.649438    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"]
Jul 21 12:54:58.652581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.652565    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.655823 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.655805    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 12:54:58.657249 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.657230    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 12:54:58.657304 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.657265    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kth5m\""
Jul 21 12:54:58.663389 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.663372    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"]
Jul 21 12:54:58.743106 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.743081    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdlq7\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-kube-api-access-vdlq7\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.743231 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.743118    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.843368 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.843341    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdlq7\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-kube-api-access-vdlq7\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.843470 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.843378    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.853380 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.853357    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.853474 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.853460    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdlq7\" (UniqueName: \"kubernetes.io/projected/a987a04f-5874-4e6d-95f4-bab81351a9f1-kube-api-access-vdlq7\") pod \"cert-manager-cainjector-559cdd8c87-2nfc2\" (UID: \"a987a04f-5874-4e6d-95f4-bab81351a9f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:58.961202 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:58.961174    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"
Jul 21 12:54:59.087713 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:59.087671    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2"]
Jul 21 12:54:59.089725 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:54:59.089698    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda987a04f_5874_4e6d_95f4_bab81351a9f1.slice/crio-f937501552298eed1d7726db8e1fa562d613f76dac6db25ca3b0a4e8927c0856 WatchSource:0}: Error finding container f937501552298eed1d7726db8e1fa562d613f76dac6db25ca3b0a4e8927c0856: Status 404 returned error can't find the container with id f937501552298eed1d7726db8e1fa562d613f76dac6db25ca3b0a4e8927c0856
Jul 21 12:54:59.359084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:54:59.358995    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2" event={"ID":"a987a04f-5874-4e6d-95f4-bab81351a9f1","Type":"ContainerStarted","Data":"f937501552298eed1d7726db8e1fa562d613f76dac6db25ca3b0a4e8927c0856"}
Jul 21 12:55:02.377671 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:02.377618    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2" event={"ID":"a987a04f-5874-4e6d-95f4-bab81351a9f1","Type":"ContainerStarted","Data":"7e034c0d8034ecf3bb63d61c868e5b4a7134f7d29f2562146d32a5617bbfde75"}
Jul 21 12:55:02.406873 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:02.406803    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2nfc2" podStartSLOduration=1.634629938 podStartE2EDuration="4.40678117s" totalImagesPullingTime="2.772151232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:02.406409475 +0000 UTC m=+247.443439548" watchObservedRunningTime="2026-07-21 12:55:02.40678117 +0000 UTC m=+247.443811247"
Jul 21 12:55:17.826801 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:17.826723    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"]
Jul 21 12:55:17.829809 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:17.829794    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:17.833123 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:17.833095    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"openshift-lws-operator-fd8ccff4c-422g6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="07ce15a0-708c-4a0c-8f2f-5c62e9f19617" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:17.835503 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:17.835476    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 21 12:55:17.836064 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:17.835989    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-lws-operator-dockercfg-b9swk\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b9swk\"" type="*v1.Secret"
Jul 21 12:55:17.836132 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:17.836101    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 21 12:55:17.858408 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:17.858377    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"]
Jul 21 12:55:17.992244 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:17.992201    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbt6j\" (UniqueName: \"kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:17.992244 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:17.992246    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-tmp\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:18.093446 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:18.093347    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbt6j\" (UniqueName: \"kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:18.093446 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:18.093396    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-tmp\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:18.093791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:18.093770    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-tmp\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:18.842600 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:18.842568    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 12:55:19.103517 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:19.103443    2532 projected.go:291] Couldn't get configMap openshift-lws-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 21 12:55:19.103517 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:19.103475    2532 projected.go:196] Error preparing data for projected volume kube-api-access-zbt6j for pod openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6: failed to sync configmap cache: timed out waiting for the condition
Jul 21 12:55:19.103688 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:55:19.103543    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j podName:07ce15a0-708c-4a0c-8f2f-5c62e9f19617 nodeName:}" failed. No retries permitted until 2026-07-21 12:55:19.603526811 +0000 UTC m=+264.640556865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbt6j" (UniqueName: "kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j") pod "openshift-lws-operator-fd8ccff4c-422g6" (UID: "07ce15a0-708c-4a0c-8f2f-5c62e9f19617") : failed to sync configmap cache: timed out waiting for the condition
Jul 21 12:55:19.127040 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.127016    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 12:55:19.231795 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.231771    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b9swk\""
Jul 21 12:55:19.606551 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.606517    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbt6j\" (UniqueName: \"kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:19.609121 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.609092    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbt6j\" (UniqueName: \"kubernetes.io/projected/07ce15a0-708c-4a0c-8f2f-5c62e9f19617-kube-api-access-zbt6j\") pod \"openshift-lws-operator-fd8ccff4c-422g6\" (UID: \"07ce15a0-708c-4a0c-8f2f-5c62e9f19617\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:19.637996 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.637974    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"
Jul 21 12:55:19.790417 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:55:19.790277    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07ce15a0_708c_4a0c_8f2f_5c62e9f19617.slice/crio-9f456b1de59a790e75c07b6ac2237634b73475a338aaf274c2d999c05c7eb2bf WatchSource:0}: Error finding container 9f456b1de59a790e75c07b6ac2237634b73475a338aaf274c2d999c05c7eb2bf: Status 404 returned error can't find the container with id 9f456b1de59a790e75c07b6ac2237634b73475a338aaf274c2d999c05c7eb2bf
Jul 21 12:55:19.792112 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:19.792076    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6"]
Jul 21 12:55:20.447568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:20.447538    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6" event={"ID":"07ce15a0-708c-4a0c-8f2f-5c62e9f19617","Type":"ContainerStarted","Data":"9f456b1de59a790e75c07b6ac2237634b73475a338aaf274c2d999c05c7eb2bf"}
Jul 21 12:55:22.457516 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:22.457475    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6" event={"ID":"07ce15a0-708c-4a0c-8f2f-5c62e9f19617","Type":"ContainerStarted","Data":"27d1663fca365c9cf263ea16c1199706a1767375be75d84ce38afa1aa389f4ea"}
Jul 21 12:55:22.475376 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:22.475330    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-422g6" podStartSLOduration=2.983397267 podStartE2EDuration="5.475314718s" totalImagesPullingTime="2.491917451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:22.473740597 +0000 UTC m=+267.510770671" watchObservedRunningTime="2026-07-21 12:55:22.475314718 +0000 UTC m=+267.512344792"
Jul 21 12:55:24.655037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.654995    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"]
Jul 21 12:55:24.658565 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.658542    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.661357 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.661326    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gwfgb\""
Jul 21 12:55:24.661357 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.661352    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 12:55:24.662565 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.662549    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 12:55:24.667866 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.667846    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"]
Jul 21 12:55:24.748207 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.748125    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82ft\" (UniqueName: \"kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.748207 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.748185    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.748428 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.748282    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.849031 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.848996    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.849240 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.849056    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.849240 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.849091    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82ft\" (UniqueName: \"kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.849398 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.849379    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.849481 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.849460    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.858480 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.858455    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82ft\" (UniqueName: \"kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:24.967749 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:24.967721    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:25.099198 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:25.099011    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"]
Jul 21 12:55:25.101654 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:55:25.101620    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc162d8bb_cab7_4a22_b35e_d6ea6714c54d.slice/crio-765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2 WatchSource:0}: Error finding container 765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2: Status 404 returned error can't find the container with id 765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2
Jul 21 12:55:25.471395 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:25.471364    2532 generic.go:356] "Generic (PLEG): container finished" podID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerID="bc85985b581669e9c518ff12903e67c2a5089d5cf0cef9e1aa0ebf138320b366" exitCode=0
Jul 21 12:55:25.471586 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:25.471450    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs" event={"ID":"c162d8bb-cab7-4a22-b35e-d6ea6714c54d","Type":"ContainerDied","Data":"bc85985b581669e9c518ff12903e67c2a5089d5cf0cef9e1aa0ebf138320b366"}
Jul 21 12:55:25.471586 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:25.471502    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs" event={"ID":"c162d8bb-cab7-4a22-b35e-d6ea6714c54d","Type":"ContainerStarted","Data":"765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2"}
Jul 21 12:55:26.476897 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:26.476863    2532 generic.go:356] "Generic (PLEG): container finished" podID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerID="c5104534ec6a9621a4261c5c3fff7848187a959b1206751f33b6881c2f3c038a" exitCode=0
Jul 21 12:55:26.477279 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:26.476913    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs" event={"ID":"c162d8bb-cab7-4a22-b35e-d6ea6714c54d","Type":"ContainerDied","Data":"c5104534ec6a9621a4261c5c3fff7848187a959b1206751f33b6881c2f3c038a"}
Jul 21 12:55:27.482582 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:27.482549    2532 generic.go:356] "Generic (PLEG): container finished" podID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerID="79b08bfcbc7a5a7c0ab065a4b3edc812a53b3851615dc36aea50870bb08774c3" exitCode=0
Jul 21 12:55:27.482958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:27.482629    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs" event={"ID":"c162d8bb-cab7-4a22-b35e-d6ea6714c54d","Type":"ContainerDied","Data":"79b08bfcbc7a5a7c0ab065a4b3edc812a53b3851615dc36aea50870bb08774c3"}
Jul 21 12:55:28.609069 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.609046    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:28.779856 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.779766    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k82ft\" (UniqueName: \"kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft\") pod \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") "
Jul 21 12:55:28.779856 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.779845    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle\") pod \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") "
Jul 21 12:55:28.780110 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.779886    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util\") pod \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\" (UID: \"c162d8bb-cab7-4a22-b35e-d6ea6714c54d\") "
Jul 21 12:55:28.780519 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.780491    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle" (OuterVolumeSpecName: "bundle") pod "c162d8bb-cab7-4a22-b35e-d6ea6714c54d" (UID: "c162d8bb-cab7-4a22-b35e-d6ea6714c54d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:55:28.782014 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.781985    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft" (OuterVolumeSpecName: "kube-api-access-k82ft") pod "c162d8bb-cab7-4a22-b35e-d6ea6714c54d" (UID: "c162d8bb-cab7-4a22-b35e-d6ea6714c54d"). InnerVolumeSpecName "kube-api-access-k82ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:55:28.788321 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.788296    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util" (OuterVolumeSpecName: "util") pod "c162d8bb-cab7-4a22-b35e-d6ea6714c54d" (UID: "c162d8bb-cab7-4a22-b35e-d6ea6714c54d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:55:28.880466 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.880431    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k82ft\" (UniqueName: \"kubernetes.io/projected/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-kube-api-access-k82ft\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:55:28.880466 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.880464    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:55:28.880466 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:28.880473    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c162d8bb-cab7-4a22-b35e-d6ea6714c54d-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:55:29.492433 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:29.492403    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs" event={"ID":"c162d8bb-cab7-4a22-b35e-d6ea6714c54d","Type":"ContainerDied","Data":"765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2"}
Jul 21 12:55:29.492568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:29.492447    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765d7c59c3d7c6d9b1744b446f3b222d63080ecaa8e0dadfd2eef8629870b8e2"
Jul 21 12:55:29.492568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:29.492418    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm8pqs"
Jul 21 12:55:42.165720 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.165681    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"]
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166027    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="util"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166039    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="util"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166048    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="extract"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166053    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="extract"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166067    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="pull"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166073    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="pull"
Jul 21 12:55:42.166145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.166127    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c162d8bb-cab7-4a22-b35e-d6ea6714c54d" containerName="extract"
Jul 21 12:55:42.170558 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.170543    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.173926 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.173906    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 12:55:42.174192 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.174179    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w8lq5\""
Jul 21 12:55:42.174457 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.174445    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 12:55:42.175083 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.175069    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 12:55:42.175242 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.175224    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 12:55:42.200205 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.200173    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"]
Jul 21 12:55:42.274259 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.274215    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.274437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.274271    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.274437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.274381    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.274437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.274410    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.274437 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.274433    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbpbb\" (UniqueName: \"kubernetes.io/projected/4780c830-e1ff-4477-bb11-c83ef287d343-kube-api-access-rbpbb\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375241 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375207    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375241 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375246    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375507 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375284    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375507 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375303    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375507 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375321    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbpbb\" (UniqueName: \"kubernetes.io/projected/4780c830-e1ff-4477-bb11-c83ef287d343-kube-api-access-rbpbb\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.375768 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.375736    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-manifests\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.377815 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.377794    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4780c830-e1ff-4477-bb11-c83ef287d343-tmp\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.377922 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.377870    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.377979 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.377938    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4780c830-e1ff-4477-bb11-c83ef287d343-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.385814 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.385790    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbpbb\" (UniqueName: \"kubernetes.io/projected/4780c830-e1ff-4477-bb11-c83ef287d343-kube-api-access-rbpbb\") pod \"opendatahub-operator-controller-manager-59f884b5-rms67\" (UID: \"4780c830-e1ff-4477-bb11-c83ef287d343\") " pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.480924 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.480893    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:42.619761 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:42.619734    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"]
Jul 21 12:55:42.622094 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:55:42.622066    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4780c830_e1ff_4477_bb11_c83ef287d343.slice/crio-99bcfee3ef8abbb619998c3d2e84003a2ae10b572153ea7edbc0ba9f991d45a7 WatchSource:0}: Error finding container 99bcfee3ef8abbb619998c3d2e84003a2ae10b572153ea7edbc0ba9f991d45a7: Status 404 returned error can't find the container with id 99bcfee3ef8abbb619998c3d2e84003a2ae10b572153ea7edbc0ba9f991d45a7
Jul 21 12:55:43.555361 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:43.555291    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67" event={"ID":"4780c830-e1ff-4477-bb11-c83ef287d343","Type":"ContainerStarted","Data":"99bcfee3ef8abbb619998c3d2e84003a2ae10b572153ea7edbc0ba9f991d45a7"}
Jul 21 12:55:46.575839 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:46.575792    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67" event={"ID":"4780c830-e1ff-4477-bb11-c83ef287d343","Type":"ContainerStarted","Data":"8e8c91d9d59cd64c2f3ca9da1c2562de793760dfdaf6c6cfc7084fa2b53de78b"}
Jul 21 12:55:47.582075 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:47.582035    2532 generic.go:356] "Generic (PLEG): container finished" podID="4780c830-e1ff-4477-bb11-c83ef287d343" containerID="8e8c91d9d59cd64c2f3ca9da1c2562de793760dfdaf6c6cfc7084fa2b53de78b" exitCode=0
Jul 21 12:55:47.582491 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:47.582140    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67" event={"ID":"4780c830-e1ff-4477-bb11-c83ef287d343","Type":"ContainerDied","Data":"8e8c91d9d59cd64c2f3ca9da1c2562de793760dfdaf6c6cfc7084fa2b53de78b"}
Jul 21 12:55:48.588503 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:48.588467    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67" event={"ID":"4780c830-e1ff-4477-bb11-c83ef287d343","Type":"ContainerStarted","Data":"b96505584557d313242a85ffabb14e5a3f1d0cc116c6a095378bc6695e9d7c11"}
Jul 21 12:55:48.588874 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:48.588588    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:55:48.620398 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:48.620350    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67" podStartSLOduration=2.176420435 podStartE2EDuration="6.620336286s" totalImagesPullingTime="3.442403999s" totalInitContainerRuntime="1.001511852s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:55:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:55:48.617692184 +0000 UTC m=+293.654722258" watchObservedRunningTime="2026-07-21 12:55:48.620336286 +0000 UTC m=+293.657366359"
Jul 21 12:55:55.275001 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:55.274911    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 12:55:55.277830 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:55.277802    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 12:55:55.286128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:55.286111    2532 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 12:55:59.594881 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:55:59.594850    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59f884b5-rms67"
Jul 21 12:56:02.439466 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.439432    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"]
Jul 21 12:56:02.442662 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.442643    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.445537 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.445518    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 12:56:02.445779 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.445765    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 12:56:02.446091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.446079    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 12:56:02.446924 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.446906    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fbjsw\""
Jul 21 12:56:02.447007 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.446907    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 12:56:02.462290 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.462258    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"]
Jul 21 12:56:02.504332 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.504308    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hws5\" (UniqueName: \"kubernetes.io/projected/6f0b535a-395d-437b-90eb-48452adf85d2-kube-api-access-4hws5\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.504436 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.504336    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.504436 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.504356    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f0b535a-395d-437b-90eb-48452adf85d2-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.605679 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.605649    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hws5\" (UniqueName: \"kubernetes.io/projected/6f0b535a-395d-437b-90eb-48452adf85d2-kube-api-access-4hws5\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.605679 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.605683    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.605829 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.605701    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f0b535a-395d-437b-90eb-48452adf85d2-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.605829 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:02.605823    2532 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 21 12:56:02.605942 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:02.605930    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs podName:6f0b535a-395d-437b-90eb-48452adf85d2 nodeName:}" failed. No retries permitted until 2026-07-21 12:56:03.105900846 +0000 UTC m=+308.142930898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs") pod "kube-auth-proxy-6d6bb59bf6-gc2hv" (UID: "6f0b535a-395d-437b-90eb-48452adf85d2") : secret "kube-auth-proxy-tls" not found
Jul 21 12:56:02.608217 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.608195    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f0b535a-395d-437b-90eb-48452adf85d2-tmp\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.634615 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.634584    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hws5\" (UniqueName: \"kubernetes.io/projected/6f0b535a-395d-437b-90eb-48452adf85d2-kube-api-access-4hws5\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:02.899238 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.899202    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmqff"]
Jul 21 12:56:02.902664 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.902648    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:02.906207 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.906183    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v27fg\""
Jul 21 12:56:02.908598 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.908580    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 12:56:02.937455 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:02.937428    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmqff"]
Jul 21 12:56:03.008487 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.008460    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.008617 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.008500    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kl6f\" (UniqueName: \"kubernetes.io/projected/d142ea37-b32e-4261-a6fb-22edae766894-kube-api-access-7kl6f\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.109557 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.109520    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:03.109557 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.109563    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.109803 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.109588    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kl6f\" (UniqueName: \"kubernetes.io/projected/d142ea37-b32e-4261-a6fb-22edae766894-kube-api-access-7kl6f\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.109803 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:03.109690    2532 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 12:56:03.109803 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:03.109759    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert podName:d142ea37-b32e-4261-a6fb-22edae766894 nodeName:}" failed. No retries permitted until 2026-07-21 12:56:03.609743049 +0000 UTC m=+308.646773105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert") pod "odh-model-controller-7998c67dc4-qmqff" (UID: "d142ea37-b32e-4261-a6fb-22edae766894") : secret "odh-model-controller-webhook-cert" not found
Jul 21 12:56:03.112105 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.112082    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0b535a-395d-437b-90eb-48452adf85d2-tls-certs\") pod \"kube-auth-proxy-6d6bb59bf6-gc2hv\" (UID: \"6f0b535a-395d-437b-90eb-48452adf85d2\") " pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:03.123441 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.123421    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kl6f\" (UniqueName: \"kubernetes.io/projected/d142ea37-b32e-4261-a6fb-22edae766894-kube-api-access-7kl6f\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.351945 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.351917    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"
Jul 21 12:56:03.520235 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.520211    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv"]
Jul 21 12:56:03.521672 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:03.521651    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0b535a_395d_437b_90eb_48452adf85d2.slice/crio-7bac25e8f2fc5ea20b4b2f24b35ca22ae8916c572644a096e44c6d57fac4c8b2 WatchSource:0}: Error finding container 7bac25e8f2fc5ea20b4b2f24b35ca22ae8916c572644a096e44c6d57fac4c8b2: Status 404 returned error can't find the container with id 7bac25e8f2fc5ea20b4b2f24b35ca22ae8916c572644a096e44c6d57fac4c8b2
Jul 21 12:56:03.523334 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.523319    2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 12:56:03.614468 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.614384    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.616975 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.616951    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d142ea37-b32e-4261-a6fb-22edae766894-cert\") pod \"odh-model-controller-7998c67dc4-qmqff\" (UID: \"d142ea37-b32e-4261-a6fb-22edae766894\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.653053 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.653028    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv" event={"ID":"6f0b535a-395d-437b-90eb-48452adf85d2","Type":"ContainerStarted","Data":"7bac25e8f2fc5ea20b4b2f24b35ca22ae8916c572644a096e44c6d57fac4c8b2"}
Jul 21 12:56:03.813176 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.813128    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:03.950500 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.950472    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wvvgw"]
Jul 21 12:56:03.953909 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.953891    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:03.956915 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.956881    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 12:56:03.967853 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.967800    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmqff"]
Jul 21 12:56:03.971809 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:03.971251    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd142ea37_b32e_4261_a6fb_22edae766894.slice/crio-5592f6e739ac8265445db87ed1654df714cc6ed78f764875f9dcd88052246433 WatchSource:0}: Error finding container 5592f6e739ac8265445db87ed1654df714cc6ed78f764875f9dcd88052246433: Status 404 returned error can't find the container with id 5592f6e739ac8265445db87ed1654df714cc6ed78f764875f9dcd88052246433
Jul 21 12:56:03.979589 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:03.979566    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wvvgw"]
Jul 21 12:56:04.017655 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.017626    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d64da43-7f6b-464e-8023-755c46865eaa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.017810 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.017729    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwblm\" (UniqueName: \"kubernetes.io/projected/8d64da43-7f6b-464e-8023-755c46865eaa-kube-api-access-nwblm\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.118739 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.118648    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d64da43-7f6b-464e-8023-755c46865eaa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.118910 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.118751    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwblm\" (UniqueName: \"kubernetes.io/projected/8d64da43-7f6b-464e-8023-755c46865eaa-kube-api-access-nwblm\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.121539 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.121513    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d64da43-7f6b-464e-8023-755c46865eaa-tls-certs\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.130453 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.130417    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwblm\" (UniqueName: \"kubernetes.io/projected/8d64da43-7f6b-464e-8023-755c46865eaa-kube-api-access-nwblm\") pod \"model-serving-api-54d89bd5fc-wvvgw\" (UID: \"8d64da43-7f6b-464e-8023-755c46865eaa\") " pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.267301 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.267265    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:04.455871 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.455792    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wvvgw"]
Jul 21 12:56:04.458628 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:04.458587    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d64da43_7f6b_464e_8023_755c46865eaa.slice/crio-cee3f5e4e2870c989960f034edf23b7812e5c34e9705c825d5998f06bb1a2add WatchSource:0}: Error finding container cee3f5e4e2870c989960f034edf23b7812e5c34e9705c825d5998f06bb1a2add: Status 404 returned error can't find the container with id cee3f5e4e2870c989960f034edf23b7812e5c34e9705c825d5998f06bb1a2add
Jul 21 12:56:04.471740 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.471714    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:04.476295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.476273    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.480906 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.480834    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mqnjn\""
Jul 21 12:56:04.481091 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.481074    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 12:56:04.481177 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.481100    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 12:56:04.481412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.481388    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 12:56:04.481517 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.481486    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 12:56:04.492543 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.492516    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:04.522773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522704    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.522773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522748    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.523309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522781    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv47n\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.523309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522811    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.523309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522837    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.523309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522864    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.523309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.522905    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.623862 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623779    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.623862 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623829    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.624084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623868    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv47n\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.624084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623904    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.624084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623937    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.624084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.623965    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.624084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.624022    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.625127 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.625070    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.626694 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.626650    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.627126 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.627103    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.627248 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.627186    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.627961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.627941    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.633931 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.633906    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.634109 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.634090    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv47n\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n\") pod \"istiod-openshift-gateway-7574459656-jg9b6\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.659620 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.659581    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff" event={"ID":"d142ea37-b32e-4261-a6fb-22edae766894","Type":"ContainerStarted","Data":"5592f6e739ac8265445db87ed1654df714cc6ed78f764875f9dcd88052246433"}
Jul 21 12:56:04.660894 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.660863    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw" event={"ID":"8d64da43-7f6b-464e-8023-755c46865eaa","Type":"ContainerStarted","Data":"cee3f5e4e2870c989960f034edf23b7812e5c34e9705c825d5998f06bb1a2add"}
Jul 21 12:56:04.791648 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.791612    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:04.970253 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:04.970232    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:05.759316 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:05.759284    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a69d20_db10_49f2_87d5_915cea60152c.slice/crio-1af22de503082719156a46868101d5255da95b19c75d74b151f0e0365bbe703d WatchSource:0}: Error finding container 1af22de503082719156a46868101d5255da95b19c75d74b151f0e0365bbe703d: Status 404 returned error can't find the container with id 1af22de503082719156a46868101d5255da95b19c75d74b151f0e0365bbe703d
Jul 21 12:56:06.673312 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:06.673264    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" event={"ID":"86a69d20-db10-49f2-87d5-915cea60152c","Type":"ContainerStarted","Data":"1af22de503082719156a46868101d5255da95b19c75d74b151f0e0365bbe703d"}
Jul 21 12:56:08.702536 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:08.702503    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 12:56:08.702827 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:08.702572    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 12:56:09.689510 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.689474    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff" event={"ID":"d142ea37-b32e-4261-a6fb-22edae766894","Type":"ContainerStarted","Data":"45bcb309ede301d555f853b95eec0592a327941d71bff1bff885338da9fdec16"}
Jul 21 12:56:09.689808 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.689791    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:09.691364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.691338    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" event={"ID":"86a69d20-db10-49f2-87d5-915cea60152c","Type":"ContainerStarted","Data":"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"}
Jul 21 12:56:09.691478 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.691386    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:09.693133 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.693109    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv" event={"ID":"6f0b535a-395d-437b-90eb-48452adf85d2","Type":"ContainerStarted","Data":"cc7f36785490a1682ee8b0039310e5e0161948d97cd30c08c4217b0b008932e5"}
Jul 21 12:56:09.693255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.693203    2532 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jg9b6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 12:56:09.693255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.693244    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" podUID="86a69d20-db10-49f2-87d5-915cea60152c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 12:56:09.694609 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.694589    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw" event={"ID":"8d64da43-7f6b-464e-8023-755c46865eaa","Type":"ContainerStarted","Data":"102a13a23ffe24745aade7184f0fa447e6c4707dd3dc69a276fee1991fbd9bff"}
Jul 21 12:56:09.694726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.694709    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:09.717782 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.717734    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff" podStartSLOduration=3.063222892 podStartE2EDuration="7.717716566s" totalImagesPullingTime="4.654493674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:09.716835798 +0000 UTC m=+314.753865872" watchObservedRunningTime="2026-07-21 12:56:09.717716566 +0000 UTC m=+314.754746635"
Jul 21 12:56:09.782685 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.782642    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d6bb59bf6-gc2hv" podStartSLOduration=2.681715616 podStartE2EDuration="7.782626219s" totalImagesPullingTime="5.100910603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:09.781057703 +0000 UTC m=+314.818087778" watchObservedRunningTime="2026-07-21 12:56:09.782626219 +0000 UTC m=+314.819656336"
Jul 21 12:56:09.783396 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.783372    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw" podStartSLOduration=2.61215949 podStartE2EDuration="6.78336551s" totalImagesPullingTime="4.17120602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:09.752078657 +0000 UTC m=+314.789108730" watchObservedRunningTime="2026-07-21 12:56:09.78336551 +0000 UTC m=+314.820395584"
Jul 21 12:56:09.849875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:09.849820    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" podStartSLOduration=2.909014591 podStartE2EDuration="5.849802357s" totalImagesPullingTime="2.940787766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:09.848958443 +0000 UTC m=+314.885988518" watchObservedRunningTime="2026-07-21 12:56:09.849802357 +0000 UTC m=+314.886832431"
Jul 21 12:56:10.701022 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:10.700996    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:13.607739 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.607710    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"]
Jul 21 12:56:13.611104 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.611087    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.615332 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.615309    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m9n8b\""
Jul 21 12:56:13.616629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.616612    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 12:56:13.624451 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.624432    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"]
Jul 21 12:56:13.627717 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.627699    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.631324 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:13.631245    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret"
Jul 21 12:56:13.631324 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:13.631300    2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-8tjln\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8tjln\"" type="*v1.Secret"
Jul 21 12:56:13.633305 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.633279    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"]
Jul 21 12:56:13.656400 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.656375    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"]
Jul 21 12:56:13.703650 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.703620    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2sp\" (UniqueName: \"kubernetes.io/projected/0e66d7f5-048d-4928-8dce-2b705fe40f85-kube-api-access-2d2sp\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.703650 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.703655    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-cert\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.703834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.703680    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68swb\" (UniqueName: \"kubernetes.io/projected/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-kube-api-access-68swb\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.703834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.703728    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e66d7f5-048d-4928-8dce-2b705fe40f85-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.804725 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.804690    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-cert\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.804859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.804739    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68swb\" (UniqueName: \"kubernetes.io/projected/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-kube-api-access-68swb\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.804859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.804790    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e66d7f5-048d-4928-8dce-2b705fe40f85-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.804859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.804854    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2sp\" (UniqueName: \"kubernetes.io/projected/0e66d7f5-048d-4928-8dce-2b705fe40f85-kube-api-access-2d2sp\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.807355 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.807335    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e66d7f5-048d-4928-8dce-2b705fe40f85-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.816001 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.815969    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2sp\" (UniqueName: \"kubernetes.io/projected/0e66d7f5-048d-4928-8dce-2b705fe40f85-kube-api-access-2d2sp\") pod \"llmisvc-controller-manager-777c6bd7d5-4jg8r\" (UID: \"0e66d7f5-048d-4928-8dce-2b705fe40f85\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:13.816275 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.816258    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68swb\" (UniqueName: \"kubernetes.io/projected/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-kube-api-access-68swb\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:13.922332 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:13.922241    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:14.090638 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:14.090607    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e66d7f5_048d_4928_8dce_2b705fe40f85.slice/crio-bd6d060292f46cf5ba3679bccb15f985b2065b908608304d16e33f048e79de2a WatchSource:0}: Error finding container bd6d060292f46cf5ba3679bccb15f985b2065b908608304d16e33f048e79de2a: Status 404 returned error can't find the container with id bd6d060292f46cf5ba3679bccb15f985b2065b908608304d16e33f048e79de2a
Jul 21 12:56:14.090948 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.090930    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"]
Jul 21 12:56:14.717114 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.717072    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r" event={"ID":"0e66d7f5-048d-4928-8dce-2b705fe40f85","Type":"ContainerStarted","Data":"bd6d060292f46cf5ba3679bccb15f985b2065b908608304d16e33f048e79de2a"}
Jul 21 12:56:14.743024 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.742995    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 12:56:14.747335 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.747313    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ac4a49e-0d29-4930-a7c4-884b8c1ae105-cert\") pod \"kserve-controller-manager-d6f4b65b8-jvqfx\" (UID: \"1ac4a49e-0d29-4930-a7c4-884b8c1ae105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:14.934810 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.934780    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8tjln\""
Jul 21 12:56:14.940402 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:14.940375    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:15.420618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.420366    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:15.420618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.420586    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" podUID="86a69d20-db10-49f2-87d5-915cea60152c" containerName="discovery" containerID="cri-o://6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed" gracePeriod=30
Jul 21 12:56:15.568792 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.568762    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"]
Jul 21 12:56:15.570712 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:56:15.570682    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac4a49e_0d29_4930_a7c4_884b8c1ae105.slice/crio-f0080e0ec2993140033725aef517613f2c4ee2cb62ff9d1af92a144698f2bd76 WatchSource:0}: Error finding container f0080e0ec2993140033725aef517613f2c4ee2cb62ff9d1af92a144698f2bd76: Status 404 returned error can't find the container with id f0080e0ec2993140033725aef517613f2c4ee2cb62ff9d1af92a144698f2bd76
Jul 21 12:56:15.679023 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.679000    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.718890    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.718942    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.718969    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.719011    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.719041    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.719069    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv47n\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.719791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.719137    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts\") pod \"86a69d20-db10-49f2-87d5-915cea60152c\" (UID: \"86a69d20-db10-49f2-87d5-915cea60152c\") "
Jul 21 12:56:15.720604 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.720508    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:56:15.722284 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.722255    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:56:15.722480 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.722453    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:56:15.722825 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.722787    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts" (OuterVolumeSpecName: "cacerts") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:56:15.723202 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.723134    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token" (OuterVolumeSpecName: "istio-token") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:56:15.723516 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.723488    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs" (OuterVolumeSpecName: "local-certs") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:56:15.724169 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.724124    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n" (OuterVolumeSpecName: "kube-api-access-bv47n") pod "86a69d20-db10-49f2-87d5-915cea60152c" (UID: "86a69d20-db10-49f2-87d5-915cea60152c"). InnerVolumeSpecName "kube-api-access-bv47n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:56:15.726618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.726597    2532 generic.go:356] "Generic (PLEG): container finished" podID="86a69d20-db10-49f2-87d5-915cea60152c" containerID="6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed" exitCode=0
Jul 21 12:56:15.726700 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.726689    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" event={"ID":"86a69d20-db10-49f2-87d5-915cea60152c","Type":"ContainerDied","Data":"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"}
Jul 21 12:56:15.726756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.726698    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"
Jul 21 12:56:15.726756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.726731    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6" event={"ID":"86a69d20-db10-49f2-87d5-915cea60152c","Type":"ContainerDied","Data":"1af22de503082719156a46868101d5255da95b19c75d74b151f0e0365bbe703d"}
Jul 21 12:56:15.726913 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.726752    2532 scope.go:117] "RemoveContainer" containerID="6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"
Jul 21 12:56:15.729059 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.729028    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx" event={"ID":"1ac4a49e-0d29-4930-a7c4-884b8c1ae105","Type":"ContainerStarted","Data":"f0080e0ec2993140033725aef517613f2c4ee2cb62ff9d1af92a144698f2bd76"}
Jul 21 12:56:15.737016 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.736992    2532 scope.go:117] "RemoveContainer" containerID="6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"
Jul 21 12:56:15.737364 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:56:15.737341    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed\": container with ID starting with 6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed not found: ID does not exist" containerID="6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"
Jul 21 12:56:15.737443 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.737377    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed"} err="failed to get container status \"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed\": rpc error: code = NotFound desc = could not find container \"6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed\": container with ID starting with 6db37dbfe94b5aeb9e1c5d5ac101037a54816a1c65908017a877983027ceabed not found: ID does not exist"
Jul 21 12:56:15.759935 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.759897    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:15.768907 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.768872    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jg9b6"]
Jul 21 12:56:15.819743 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819716    2532 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-cacerts\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819743 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819741    2532 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-kubeconfig\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819751    2532 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-dns-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819759    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819769    2532 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86a69d20-db10-49f2-87d5-915cea60152c-local-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819780    2532 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86a69d20-db10-49f2-87d5-915cea60152c-istio-csr-ca-configmap\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:15.819883 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:15.819788    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv47n\" (UniqueName: \"kubernetes.io/projected/86a69d20-db10-49f2-87d5-915cea60152c-kube-api-access-bv47n\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:56:17.358548 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:17.358515    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a69d20-db10-49f2-87d5-915cea60152c" path="/var/lib/kubelet/pods/86a69d20-db10-49f2-87d5-915cea60152c/volumes"
Jul 21 12:56:17.744316 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:17.744278    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r" event={"ID":"0e66d7f5-048d-4928-8dce-2b705fe40f85","Type":"ContainerStarted","Data":"e789a17a801f1fb0d4b1091ee47d236efb722acaca7cfcf50867db00f9fc27a3"}
Jul 21 12:56:17.744488 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:17.744442    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:17.770629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:17.770578    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r" podStartSLOduration=2.145719074 podStartE2EDuration="4.770563547s" totalImagesPullingTime="2.624844473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:17.770337271 +0000 UTC m=+322.807367347" watchObservedRunningTime="2026-07-21 12:56:17.770563547 +0000 UTC m=+322.807593636"
Jul 21 12:56:18.750234 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:18.750185    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx" event={"ID":"1ac4a49e-0d29-4930-a7c4-884b8c1ae105","Type":"ContainerStarted","Data":"26ecd1687bc8e49cf420d652ae083acbbf29dd308f86f7dee53363fde65cb1e2"}
Jul 21 12:56:18.750676 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:18.750474    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:56:18.776165 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:18.776117    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx" podStartSLOduration=3.510809624 podStartE2EDuration="5.776102253s" totalImagesPullingTime="2.265292629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:56:18.773861897 +0000 UTC m=+323.810891970" watchObservedRunningTime="2026-07-21 12:56:18.776102253 +0000 UTC m=+323.813132340"
Jul 21 12:56:20.702411 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:20.702379    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qmqff"
Jul 21 12:56:20.704513 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:20.704492    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wvvgw"
Jul 21 12:56:48.752275 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:48.752206    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4jg8r"
Jul 21 12:56:49.759443 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:56:49.759415    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jvqfx"
Jul 21 12:57:03.270356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.270320    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:03.270726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.270658    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a69d20-db10-49f2-87d5-915cea60152c" containerName="discovery"
Jul 21 12:57:03.270726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.270668    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a69d20-db10-49f2-87d5-915cea60152c" containerName="discovery"
Jul 21 12:57:03.270726 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.270725    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a69d20-db10-49f2-87d5-915cea60152c" containerName="discovery"
Jul 21 12:57:03.275234 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.275218    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:03.279345 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.279324    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 12:57:03.281101 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.281082    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 12:57:03.281101 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.281104    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dgqsh\""
Jul 21 12:57:03.284965 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.284945    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:03.301749 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.301713    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rf8\" (UniqueName: \"kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8\") pod \"kuadrant-operator-catalog-gzvpk\" (UID: \"e3101568-3215-46f4-a0c7-eb2a7d56ce48\") " pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:03.402287 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.402252    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rf8\" (UniqueName: \"kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8\") pod \"kuadrant-operator-catalog-gzvpk\" (UID: \"e3101568-3215-46f4-a0c7-eb2a7d56ce48\") " pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:03.412882 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.412858    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rf8\" (UniqueName: \"kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8\") pod \"kuadrant-operator-catalog-gzvpk\" (UID: \"e3101568-3215-46f4-a0c7-eb2a7d56ce48\") " pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:03.586484 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.586391    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:03.622146 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.622114    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:03.730618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.730594    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:03.733570 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:03.733538    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3101568_3215_46f4_a0c7_eb2a7d56ce48.slice/crio-70ed18329a11cbd7b941b5fc7a29bd68100c3c940778361d7bf05016ab1124aa WatchSource:0}: Error finding container 70ed18329a11cbd7b941b5fc7a29bd68100c3c940778361d7bf05016ab1124aa: Status 404 returned error can't find the container with id 70ed18329a11cbd7b941b5fc7a29bd68100c3c940778361d7bf05016ab1124aa
Jul 21 12:57:03.863364 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.863287    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj8k"]
Jul 21 12:57:03.867020 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.867004    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:03.877512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.877487    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj8k"]
Jul 21 12:57:03.905214 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.905183    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9cg\" (UniqueName: \"kubernetes.io/projected/36c1efc6-10cd-44c6-8cb8-df8239977d86-kube-api-access-md9cg\") pod \"kuadrant-operator-catalog-qhj8k\" (UID: \"36c1efc6-10cd-44c6-8cb8-df8239977d86\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:03.951849 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:03.951820    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" event={"ID":"e3101568-3215-46f4-a0c7-eb2a7d56ce48","Type":"ContainerStarted","Data":"70ed18329a11cbd7b941b5fc7a29bd68100c3c940778361d7bf05016ab1124aa"}
Jul 21 12:57:04.006056 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:04.006025    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9cg\" (UniqueName: \"kubernetes.io/projected/36c1efc6-10cd-44c6-8cb8-df8239977d86-kube-api-access-md9cg\") pod \"kuadrant-operator-catalog-qhj8k\" (UID: \"36c1efc6-10cd-44c6-8cb8-df8239977d86\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:04.018377 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:04.018347    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9cg\" (UniqueName: \"kubernetes.io/projected/36c1efc6-10cd-44c6-8cb8-df8239977d86-kube-api-access-md9cg\") pod \"kuadrant-operator-catalog-qhj8k\" (UID: \"36c1efc6-10cd-44c6-8cb8-df8239977d86\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:04.176236 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:04.176122    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:04.341284 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:04.341253    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj8k"]
Jul 21 12:57:04.376657 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:04.376629    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c1efc6_10cd_44c6_8cb8_df8239977d86.slice/crio-1dfd406b712e903c49fed3af64511337ac07eba721648bc67ddf4fd1a1131a4b WatchSource:0}: Error finding container 1dfd406b712e903c49fed3af64511337ac07eba721648bc67ddf4fd1a1131a4b: Status 404 returned error can't find the container with id 1dfd406b712e903c49fed3af64511337ac07eba721648bc67ddf4fd1a1131a4b
Jul 21 12:57:04.959236 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:04.959199    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k" event={"ID":"36c1efc6-10cd-44c6-8cb8-df8239977d86","Type":"ContainerStarted","Data":"1dfd406b712e903c49fed3af64511337ac07eba721648bc67ddf4fd1a1131a4b"}
Jul 21 12:57:05.965494 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:05.965458    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k" event={"ID":"36c1efc6-10cd-44c6-8cb8-df8239977d86","Type":"ContainerStarted","Data":"20420f1fb863b0cc9f0d3ad80a436e99386407c4671b8e04c920c2a5e6c29c7d"}
Jul 21 12:57:05.967084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:05.967051    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" event={"ID":"e3101568-3215-46f4-a0c7-eb2a7d56ce48","Type":"ContainerStarted","Data":"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"}
Jul 21 12:57:05.967252 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:05.967091    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" podUID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" containerName="registry-server" containerID="cri-o://43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288" gracePeriod=2
Jul 21 12:57:05.983742 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:05.983700    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k" podStartSLOduration=1.634153576 podStartE2EDuration="2.983684959s" totalImagesPullingTime="1.349531383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:05.982887338 +0000 UTC m=+371.019917413" watchObservedRunningTime="2026-07-21 12:57:05.983684959 +0000 UTC m=+371.020715032"
Jul 21 12:57:06.006767 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.006714    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" podStartSLOduration=1.01471618 podStartE2EDuration="3.006698869s" totalImagesPullingTime="1.991982689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:06.006124554 +0000 UTC m=+371.043154629" watchObservedRunningTime="2026-07-21 12:57:06.006698869 +0000 UTC m=+371.043728943"
Jul 21 12:57:06.205100 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.205077    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:06.220797 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.220776    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28rf8\" (UniqueName: \"kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8\") pod \"e3101568-3215-46f4-a0c7-eb2a7d56ce48\" (UID: \"e3101568-3215-46f4-a0c7-eb2a7d56ce48\") "
Jul 21 12:57:06.222922 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.222878    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8" (OuterVolumeSpecName: "kube-api-access-28rf8") pod "e3101568-3215-46f4-a0c7-eb2a7d56ce48" (UID: "e3101568-3215-46f4-a0c7-eb2a7d56ce48"). InnerVolumeSpecName "kube-api-access-28rf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:57:06.322023 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.321993    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rf8\" (UniqueName: \"kubernetes.io/projected/e3101568-3215-46f4-a0c7-eb2a7d56ce48-kube-api-access-28rf8\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:06.973215 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.973179    2532 generic.go:356] "Generic (PLEG): container finished" podID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" containerID="43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288" exitCode=0
Jul 21 12:57:06.973659 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.973271    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk"
Jul 21 12:57:06.973659 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.973315    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" event={"ID":"e3101568-3215-46f4-a0c7-eb2a7d56ce48","Type":"ContainerDied","Data":"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"}
Jul 21 12:57:06.973659 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.973361    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gzvpk" event={"ID":"e3101568-3215-46f4-a0c7-eb2a7d56ce48","Type":"ContainerDied","Data":"70ed18329a11cbd7b941b5fc7a29bd68100c3c940778361d7bf05016ab1124aa"}
Jul 21 12:57:06.973659 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.973381    2532 scope.go:117] "RemoveContainer" containerID="43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"
Jul 21 12:57:06.983288 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.983272    2532 scope.go:117] "RemoveContainer" containerID="43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"
Jul 21 12:57:06.983546 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:57:06.983527    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288\": container with ID starting with 43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288 not found: ID does not exist" containerID="43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"
Jul 21 12:57:06.983608 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.983554    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288"} err="failed to get container status \"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288\": rpc error: code = NotFound desc = could not find container \"43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288\": container with ID starting with 43352ed4e6b434ccd6c731c0a3887a7b4b780b0a22af41627eb5557b1d04c288 not found: ID does not exist"
Jul 21 12:57:06.994628 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:06.994603    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:07.001236 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:07.001191    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gzvpk"]
Jul 21 12:57:07.357393 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:07.357321    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" path="/var/lib/kubelet/pods/e3101568-3215-46f4-a0c7-eb2a7d56ce48/volumes"
Jul 21 12:57:14.177229 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:14.177202    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:14.177784 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:14.177458    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:14.199338 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:14.199315    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:15.031679 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:15.031653    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qhj8k"
Jul 21 12:57:18.886721 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.886688    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"]
Jul 21 12:57:18.887087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.887023    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" containerName="registry-server"
Jul 21 12:57:18.887087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.887034    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" containerName="registry-server"
Jul 21 12:57:18.887178 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.887089    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3101568-3215-46f4-a0c7-eb2a7d56ce48" containerName="registry-server"
Jul 21 12:57:18.890326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.890308    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:18.893264 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.893245    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s7px4\""
Jul 21 12:57:18.899125 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.899091    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"]
Jul 21 12:57:18.913349 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.913326    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:18.913447 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.913363    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9qz\" (UniqueName: \"kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:18.913447 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:18.913391    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.014709 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.014680    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9qz\" (UniqueName: \"kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.014853 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.014720    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.014853 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.014797    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.015112 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.015093    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.015181 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.015122    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.024407 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.024378    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9qz\" (UniqueName: \"kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.199628 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.199598    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:19.340045 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.339885    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"]
Jul 21 12:57:19.342783 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:19.342757    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f53bb52_4faa_4d23_8958_e65ad2411bff.slice/crio-acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805 WatchSource:0}: Error finding container acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805: Status 404 returned error can't find the container with id acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805
Jul 21 12:57:19.734967 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.734879    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"]
Jul 21 12:57:19.738260 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.738244    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.762068 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.762036    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"]
Jul 21 12:57:19.821396 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.821359    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxjc\" (UniqueName: \"kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.821568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.821432    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.821568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.821464    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.921861 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.921826    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.921861 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.921868    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.922289 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.921906    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxjc\" (UniqueName: \"kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.922327 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.922294    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.922327 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.922309    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:19.932540 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:19.932510    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxjc\" (UniqueName: \"kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:20.038690 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.038663    2532 generic.go:356] "Generic (PLEG): container finished" podID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerID="d6d184e4a1d6a4a58691ad57e6464f2cf21a6af969a031980ae696f87c8a6b4b" exitCode=0
Jul 21 12:57:20.038833 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.038702    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8" event={"ID":"3f53bb52-4faa-4d23-8958-e65ad2411bff","Type":"ContainerDied","Data":"d6d184e4a1d6a4a58691ad57e6464f2cf21a6af969a031980ae696f87c8a6b4b"}
Jul 21 12:57:20.038833 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.038738    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8" event={"ID":"3f53bb52-4faa-4d23-8958-e65ad2411bff","Type":"ContainerStarted","Data":"acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805"}
Jul 21 12:57:20.047646 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.047626    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:20.183555 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.183529    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"]
Jul 21 12:57:20.184910 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:20.184883    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba01c881_2a9e_4750_8ff7_169d584c2dd2.slice/crio-82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354 WatchSource:0}: Error finding container 82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354: Status 404 returned error can't find the container with id 82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354
Jul 21 12:57:20.475729 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.475696    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"]
Jul 21 12:57:20.479054 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.479037    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.489508 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.489484    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"]
Jul 21 12:57:20.526522 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.526493    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.526679 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.526539    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.526679 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.526616    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxd99\" (UniqueName: \"kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.627483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.627407    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxd99\" (UniqueName: \"kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.627483 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.627461    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.627698 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.627485    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.627899 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.627877    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.627951 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.627897    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.637895 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.637863    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxd99\" (UniqueName: \"kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.788712 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.788678    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:20.881908 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.881836    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"]
Jul 21 12:57:20.885764 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.885743    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:20.894145 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.894122    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"]
Jul 21 12:57:20.930246 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.930221    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:20.930573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.930328    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:20.930573 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.930358    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkrt9\" (UniqueName: \"kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:20.934465 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:20.934446    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"]
Jul 21 12:57:20.964024 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:20.963985    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba582e5_cd44_44fe_a543_a0e158f7d4ba.slice/crio-b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3 WatchSource:0}: Error finding container b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3: Status 404 returned error can't find the container with id b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3
Jul 21 12:57:21.031782 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.031756    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.031881 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.031803    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkrt9\" (UniqueName: \"kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.031881 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.031846    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.032302 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.032272    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.032387 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.032307    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.048252 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.048198    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkrt9\" (UniqueName: \"kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.052844 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.052808    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerStarted","Data":"44e2080945b36596403ace496a89682ad6a06633bdbcdcc3c4576da3fb4f4c30"}
Jul 21 12:57:21.052966 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.052907    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerStarted","Data":"b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3"}
Jul 21 12:57:21.054976 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.054950    2532 generic.go:356] "Generic (PLEG): container finished" podID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerID="b8d79154f25db286b2a1c28d6fca49fadc15469f7b6967474960cdf5cdb95d6b" exitCode=0
Jul 21 12:57:21.055106 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.055044    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8" event={"ID":"3f53bb52-4faa-4d23-8958-e65ad2411bff","Type":"ContainerDied","Data":"b8d79154f25db286b2a1c28d6fca49fadc15469f7b6967474960cdf5cdb95d6b"}
Jul 21 12:57:21.056710 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.056687    2532 generic.go:356] "Generic (PLEG): container finished" podID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerID="e81fa844a575ac4f41265088ef55fcdd7957a49034776dd86de85a3f29ddb615" exitCode=0
Jul 21 12:57:21.056800 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.056731    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh" event={"ID":"ba01c881-2a9e-4750-8ff7-169d584c2dd2","Type":"ContainerDied","Data":"e81fa844a575ac4f41265088ef55fcdd7957a49034776dd86de85a3f29ddb615"}
Jul 21 12:57:21.056800 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.056777    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh" event={"ID":"ba01c881-2a9e-4750-8ff7-169d584c2dd2","Type":"ContainerStarted","Data":"82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354"}
Jul 21 12:57:21.197230 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.197202    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:21.333586 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:21.333558    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"]
Jul 21 12:57:21.334954 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:21.334931    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd819326a_29dd_4b6c_9fa0_0a5fda09580f.slice/crio-f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f WatchSource:0}: Error finding container f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f: Status 404 returned error can't find the container with id f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f
Jul 21 12:57:22.062685 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.062655    2532 generic.go:356] "Generic (PLEG): container finished" podID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerID="e1f94c3068af6b2a0221210a0daec7d7b730b1baeb98c3f233832dab00147db6" exitCode=0
Jul 21 12:57:22.063087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.062745    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8" event={"ID":"3f53bb52-4faa-4d23-8958-e65ad2411bff","Type":"ContainerDied","Data":"e1f94c3068af6b2a0221210a0daec7d7b730b1baeb98c3f233832dab00147db6"}
Jul 21 12:57:22.064472 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.064453    2532 generic.go:356] "Generic (PLEG): container finished" podID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerID="6cdf76d83a99ace9cd785f6b5f559cf314facc0a4c494da991d439fb3cd9db6d" exitCode=0
Jul 21 12:57:22.064594 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.064478    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh" event={"ID":"ba01c881-2a9e-4750-8ff7-169d584c2dd2","Type":"ContainerDied","Data":"6cdf76d83a99ace9cd785f6b5f559cf314facc0a4c494da991d439fb3cd9db6d"}
Jul 21 12:57:22.066050 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.066030    2532 generic.go:356] "Generic (PLEG): container finished" podID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerID="44e2080945b36596403ace496a89682ad6a06633bdbcdcc3c4576da3fb4f4c30" exitCode=0
Jul 21 12:57:22.066146 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.066128    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerDied","Data":"44e2080945b36596403ace496a89682ad6a06633bdbcdcc3c4576da3fb4f4c30"}
Jul 21 12:57:22.067748 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.067555    2532 generic.go:356] "Generic (PLEG): container finished" podID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerID="81a39b3c3777428ca92c3caeceb5b67284bf122a1e9c0eafc2e51faa03cf480a" exitCode=0
Jul 21 12:57:22.067748 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.067581    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw" event={"ID":"d819326a-29dd-4b6c-9fa0-0a5fda09580f","Type":"ContainerDied","Data":"81a39b3c3777428ca92c3caeceb5b67284bf122a1e9c0eafc2e51faa03cf480a"}
Jul 21 12:57:22.067748 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:22.067623    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw" event={"ID":"d819326a-29dd-4b6c-9fa0-0a5fda09580f","Type":"ContainerStarted","Data":"f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f"}
Jul 21 12:57:23.074130 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.074101    2532 generic.go:356] "Generic (PLEG): container finished" podID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerID="d712728de52df19fc12368a79e1a3daf9145e89a02afb342903bbe700ee8988a" exitCode=0
Jul 21 12:57:23.074507 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.074195    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh" event={"ID":"ba01c881-2a9e-4750-8ff7-169d584c2dd2","Type":"ContainerDied","Data":"d712728de52df19fc12368a79e1a3daf9145e89a02afb342903bbe700ee8988a"}
Jul 21 12:57:23.077807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.077787    2532 generic.go:356] "Generic (PLEG): container finished" podID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerID="2c3a910015d953898aa47db69dfd2262081389e6002c153104aa47704a080d2d" exitCode=0
Jul 21 12:57:23.077911 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.077837    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw" event={"ID":"d819326a-29dd-4b6c-9fa0-0a5fda09580f","Type":"ContainerDied","Data":"2c3a910015d953898aa47db69dfd2262081389e6002c153104aa47704a080d2d"}
Jul 21 12:57:23.209117 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.209098    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:23.246958 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.246931    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle\") pod \"3f53bb52-4faa-4d23-8958-e65ad2411bff\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") "
Jul 21 12:57:23.247084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.246984    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util\") pod \"3f53bb52-4faa-4d23-8958-e65ad2411bff\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") "
Jul 21 12:57:23.247084 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.247016    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq9qz\" (UniqueName: \"kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz\") pod \"3f53bb52-4faa-4d23-8958-e65ad2411bff\" (UID: \"3f53bb52-4faa-4d23-8958-e65ad2411bff\") "
Jul 21 12:57:23.247562 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.247535    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle" (OuterVolumeSpecName: "bundle") pod "3f53bb52-4faa-4d23-8958-e65ad2411bff" (UID: "3f53bb52-4faa-4d23-8958-e65ad2411bff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:23.249459 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.249434    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz" (OuterVolumeSpecName: "kube-api-access-pq9qz") pod "3f53bb52-4faa-4d23-8958-e65ad2411bff" (UID: "3f53bb52-4faa-4d23-8958-e65ad2411bff"). InnerVolumeSpecName "kube-api-access-pq9qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:57:23.252704 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.252685    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util" (OuterVolumeSpecName: "util") pod "3f53bb52-4faa-4d23-8958-e65ad2411bff" (UID: "3f53bb52-4faa-4d23-8958-e65ad2411bff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:23.347987 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.347962    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:23.347987 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.347984    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f53bb52-4faa-4d23-8958-e65ad2411bff-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:23.348112 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:23.347992    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq9qz\" (UniqueName: \"kubernetes.io/projected/3f53bb52-4faa-4d23-8958-e65ad2411bff-kube-api-access-pq9qz\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:24.089296 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.089259    2532 generic.go:356] "Generic (PLEG): container finished" podID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerID="9af6e17e6ca85360f6fb6d7b6f1ea59ce12d0940b6c805a0c1ce3f1804c119f8" exitCode=0
Jul 21 12:57:24.089716 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.089343    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerDied","Data":"9af6e17e6ca85360f6fb6d7b6f1ea59ce12d0940b6c805a0c1ce3f1804c119f8"}
Jul 21 12:57:24.091498 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.091476    2532 generic.go:356] "Generic (PLEG): container finished" podID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerID="fca2501587a7245a5f1d48b9372de7bc9d325a211a7a7392f62625cda5752598" exitCode=0
Jul 21 12:57:24.091616 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.091556    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw" event={"ID":"d819326a-29dd-4b6c-9fa0-0a5fda09580f","Type":"ContainerDied","Data":"fca2501587a7245a5f1d48b9372de7bc9d325a211a7a7392f62625cda5752598"}
Jul 21 12:57:24.093319 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.093302    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8"
Jul 21 12:57:24.093423 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.093301    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8" event={"ID":"3f53bb52-4faa-4d23-8958-e65ad2411bff","Type":"ContainerDied","Data":"acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805"}
Jul 21 12:57:24.093423 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.093386    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acd4e4605a3cefefb260258c8a952f7c861cb11ce50077283447e2ca89b09805"
Jul 21 12:57:24.226996 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.226971    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:24.255816 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.255789    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util\") pod \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") "
Jul 21 12:57:24.255939 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.255831    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whxjc\" (UniqueName: \"kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc\") pod \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") "
Jul 21 12:57:24.255939 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.255863    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle\") pod \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\" (UID: \"ba01c881-2a9e-4750-8ff7-169d584c2dd2\") "
Jul 21 12:57:24.256335 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.256309    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle" (OuterVolumeSpecName: "bundle") pod "ba01c881-2a9e-4750-8ff7-169d584c2dd2" (UID: "ba01c881-2a9e-4750-8ff7-169d584c2dd2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:24.257995 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.257968    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc" (OuterVolumeSpecName: "kube-api-access-whxjc") pod "ba01c881-2a9e-4750-8ff7-169d584c2dd2" (UID: "ba01c881-2a9e-4750-8ff7-169d584c2dd2"). InnerVolumeSpecName "kube-api-access-whxjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:57:24.261025 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.261003    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util" (OuterVolumeSpecName: "util") pod "ba01c881-2a9e-4750-8ff7-169d584c2dd2" (UID: "ba01c881-2a9e-4750-8ff7-169d584c2dd2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:24.356553 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.356490    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:24.356553 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.356513    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba01c881-2a9e-4750-8ff7-169d584c2dd2-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:24.356553 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:24.356526    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whxjc\" (UniqueName: \"kubernetes.io/projected/ba01c881-2a9e-4750-8ff7-169d584c2dd2-kube-api-access-whxjc\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:25.101980 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.099804    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh"
Jul 21 12:57:25.101980 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.100317    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh" event={"ID":"ba01c881-2a9e-4750-8ff7-169d584c2dd2","Type":"ContainerDied","Data":"82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354"}
Jul 21 12:57:25.101980 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.100370    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82480c27ec484f0575a91a7e4e2f972b97fe16bf104c3635652c1d3a210c8354"
Jul 21 12:57:25.104494 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.104468    2532 generic.go:356] "Generic (PLEG): container finished" podID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerID="4a93fd4ec98a5ba9ad53da6e48e0f868cae39aae223946a84e77e8f10ac6e579" exitCode=0
Jul 21 12:57:25.104629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.104500    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerDied","Data":"4a93fd4ec98a5ba9ad53da6e48e0f868cae39aae223946a84e77e8f10ac6e579"}
Jul 21 12:57:25.235625 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.235605    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:25.264931 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.264902    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util\") pod \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") "
Jul 21 12:57:25.265063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.264946    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkrt9\" (UniqueName: \"kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9\") pod \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") "
Jul 21 12:57:25.265063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.265061    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle\") pod \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\" (UID: \"d819326a-29dd-4b6c-9fa0-0a5fda09580f\") "
Jul 21 12:57:25.265733 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.265653    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle" (OuterVolumeSpecName: "bundle") pod "d819326a-29dd-4b6c-9fa0-0a5fda09580f" (UID: "d819326a-29dd-4b6c-9fa0-0a5fda09580f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:25.267192 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.267147    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9" (OuterVolumeSpecName: "kube-api-access-qkrt9") pod "d819326a-29dd-4b6c-9fa0-0a5fda09580f" (UID: "d819326a-29dd-4b6c-9fa0-0a5fda09580f"). InnerVolumeSpecName "kube-api-access-qkrt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:57:25.274225 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.274195    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util" (OuterVolumeSpecName: "util") pod "d819326a-29dd-4b6c-9fa0-0a5fda09580f" (UID: "d819326a-29dd-4b6c-9fa0-0a5fda09580f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:25.365779 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.365758    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:25.365779 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.365780    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d819326a-29dd-4b6c-9fa0-0a5fda09580f-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:25.365903 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:25.365789    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkrt9\" (UniqueName: \"kubernetes.io/projected/d819326a-29dd-4b6c-9fa0-0a5fda09580f-kube-api-access-qkrt9\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:26.111568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.111529    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw" event={"ID":"d819326a-29dd-4b6c-9fa0-0a5fda09580f","Type":"ContainerDied","Data":"f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f"}
Jul 21 12:57:26.111568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.111558    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw"
Jul 21 12:57:26.111973 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.111608    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2632b9069eaddfb924db5f6c6b60a3a2209dba2459585a70a26c7dd9340899f"
Jul 21 12:57:26.241012 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.240991    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:26.272676 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.272655    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxd99\" (UniqueName: \"kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99\") pod \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") "
Jul 21 12:57:26.272814 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.272688    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle\") pod \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") "
Jul 21 12:57:26.272814 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.272723    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util\") pod \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\" (UID: \"2ba582e5-cd44-44fe-a543-a0e158f7d4ba\") "
Jul 21 12:57:26.273130 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.273104    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle" (OuterVolumeSpecName: "bundle") pod "2ba582e5-cd44-44fe-a543-a0e158f7d4ba" (UID: "2ba582e5-cd44-44fe-a543-a0e158f7d4ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:26.274992 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.274965    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99" (OuterVolumeSpecName: "kube-api-access-mxd99") pod "2ba582e5-cd44-44fe-a543-a0e158f7d4ba" (UID: "2ba582e5-cd44-44fe-a543-a0e158f7d4ba"). InnerVolumeSpecName "kube-api-access-mxd99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:57:26.278102 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.278063    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util" (OuterVolumeSpecName: "util") pod "2ba582e5-cd44-44fe-a543-a0e158f7d4ba" (UID: "2ba582e5-cd44-44fe-a543-a0e158f7d4ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:57:26.373854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.373799    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxd99\" (UniqueName: \"kubernetes.io/projected/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-kube-api-access-mxd99\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:26.373854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.373819    2532 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:26.373854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:26.373829    2532 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ba582e5-cd44-44fe-a543-a0e158f7d4ba-util\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:57:27.118528 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:27.118498    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9" event={"ID":"2ba582e5-cd44-44fe-a543-a0e158f7d4ba","Type":"ContainerDied","Data":"b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3"}
Jul 21 12:57:27.118875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:27.118546    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9"
Jul 21 12:57:27.118875 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:27.118549    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b10017b550624c3a28caa94114da362133838b8d0593dd40199937bbd1a812c3"
Jul 21 12:57:35.631677 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.631639    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"]
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.631974    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="extract"
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.631989    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="extract"
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.631997    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="extract"
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632002    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="extract"
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632037    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="pull"
Jul 21 12:57:35.632063 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632043    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632051    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632074    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632080    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632085    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632092    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632097    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632103    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632108    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632113    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632118    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632124    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632129    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632137    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632145    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632168    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632172    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="util"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632178    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632182    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="pull"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632248    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba01c881-2a9e-4750-8ff7-169d584c2dd2" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632257    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba582e5-cd44-44fe-a543-a0e158f7d4ba" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632263    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f53bb52-4faa-4d23-8958-e65ad2411bff" containerName="extract"
Jul 21 12:57:35.632295 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.632267    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d819326a-29dd-4b6c-9fa0-0a5fda09580f" containerName="extract"
Jul 21 12:57:35.635551 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.635534    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:35.639232 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.639210    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mzls8\""
Jul 21 12:57:35.646258 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.646226    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"]
Jul 21 12:57:35.751782 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.751732    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b899j\" (UniqueName: \"kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmq6\" (UID: \"cd6f957c-e583-4930-a834-c70a75a56ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:35.853105 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.853068    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b899j\" (UniqueName: \"kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmq6\" (UID: \"cd6f957c-e583-4930-a834-c70a75a56ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:35.868597 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.868563    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b899j\" (UniqueName: \"kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j\") pod \"limitador-operator-controller-manager-859d7b78bd-6kmq6\" (UID: \"cd6f957c-e583-4930-a834-c70a75a56ffc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:35.945596 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:35.945567    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:36.100842 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:36.100819    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"]
Jul 21 12:57:36.102535 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:36.102510    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6f957c_e583_4930_a834_c70a75a56ffc.slice/crio-e0a575312a8acb342e9301fdbfe7bfb38781259ef5b18978ec4b9b2b3ba1f87d WatchSource:0}: Error finding container e0a575312a8acb342e9301fdbfe7bfb38781259ef5b18978ec4b9b2b3ba1f87d: Status 404 returned error can't find the container with id e0a575312a8acb342e9301fdbfe7bfb38781259ef5b18978ec4b9b2b3ba1f87d
Jul 21 12:57:36.161533 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:36.161487    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6" event={"ID":"cd6f957c-e583-4930-a834-c70a75a56ffc","Type":"ContainerStarted","Data":"e0a575312a8acb342e9301fdbfe7bfb38781259ef5b18978ec4b9b2b3ba1f87d"}
Jul 21 12:57:38.173355 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:38.173314    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6" event={"ID":"cd6f957c-e583-4930-a834-c70a75a56ffc","Type":"ContainerStarted","Data":"8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec"}
Jul 21 12:57:38.173773 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:38.173407    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:38.213028 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:38.212977    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6" podStartSLOduration=1.720692112 podStartE2EDuration="3.212958384s" totalImagesPullingTime="1.492266272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:38.211550089 +0000 UTC m=+403.248580162" watchObservedRunningTime="2026-07-21 12:57:38.212958384 +0000 UTC m=+403.249988458"
Jul 21 12:57:40.861350 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:40.861315    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"]
Jul 21 12:57:40.864268 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:40.864252    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:40.867643 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:40.867626    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-scmm2\""
Jul 21 12:57:40.878094 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:40.878071    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"]
Jul 21 12:57:41.000050 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.000024    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rcf\" (UniqueName: \"kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.000213 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.000075    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.100926 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.100896    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rcf\" (UniqueName: \"kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.101086 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.100949    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.101326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.101308    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.118800 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.118751    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rcf\" (UniqueName: \"kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.173611 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.173577    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:41.320613 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:41.320584    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"]
Jul 21 12:57:41.322406 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:41.322377    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa780773_479d_4a3d_8e97_9ccfb7d4d786.slice/crio-fa23e2aa643d552dae18991c1a87e02030e68d95a7c28f81f29b115bb1f37fe8 WatchSource:0}: Error finding container fa23e2aa643d552dae18991c1a87e02030e68d95a7c28f81f29b115bb1f37fe8: Status 404 returned error can't find the container with id fa23e2aa643d552dae18991c1a87e02030e68d95a7c28f81f29b115bb1f37fe8
Jul 21 12:57:42.201756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:42.201720    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6" event={"ID":"aa780773-479d-4a3d-8e97-9ccfb7d4d786","Type":"ContainerStarted","Data":"fa23e2aa643d552dae18991c1a87e02030e68d95a7c28f81f29b115bb1f37fe8"}
Jul 21 12:57:43.394632 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.394597    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"]
Jul 21 12:57:43.398439 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.398411    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:43.403651 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.403629    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5s67q\""
Jul 21 12:57:43.414323 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.414301    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"]
Jul 21 12:57:43.521028 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.520995    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455pl\" (UniqueName: \"kubernetes.io/projected/664ad3f1-b529-4f38-b50b-e5ad2e4f32f6-kube-api-access-455pl\") pod \"authorino-operator-75cc8d5cb7-6rzz4\" (UID: \"664ad3f1-b529-4f38-b50b-e5ad2e4f32f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:43.622027 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.621996    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455pl\" (UniqueName: \"kubernetes.io/projected/664ad3f1-b529-4f38-b50b-e5ad2e4f32f6-kube-api-access-455pl\") pod \"authorino-operator-75cc8d5cb7-6rzz4\" (UID: \"664ad3f1-b529-4f38-b50b-e5ad2e4f32f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:43.635510 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.635482    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455pl\" (UniqueName: \"kubernetes.io/projected/664ad3f1-b529-4f38-b50b-e5ad2e4f32f6-kube-api-access-455pl\") pod \"authorino-operator-75cc8d5cb7-6rzz4\" (UID: \"664ad3f1-b529-4f38-b50b-e5ad2e4f32f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:43.712519 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.712499    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:43.865272 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:43.865250    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"]
Jul 21 12:57:43.867093 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:57:43.867065    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664ad3f1_b529_4f38_b50b_e5ad2e4f32f6.slice/crio-15fd97cfc0316d3396c5839ef0a03f7558330b56b26f25e08021c88606df48cc WatchSource:0}: Error finding container 15fd97cfc0316d3396c5839ef0a03f7558330b56b26f25e08021c88606df48cc: Status 404 returned error can't find the container with id 15fd97cfc0316d3396c5839ef0a03f7558330b56b26f25e08021c88606df48cc
Jul 21 12:57:44.214859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:44.214825    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4" event={"ID":"664ad3f1-b529-4f38-b50b-e5ad2e4f32f6","Type":"ContainerStarted","Data":"15fd97cfc0316d3396c5839ef0a03f7558330b56b26f25e08021c88606df48cc"}
Jul 21 12:57:48.240748 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.240710    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6" event={"ID":"aa780773-479d-4a3d-8e97-9ccfb7d4d786","Type":"ContainerStarted","Data":"1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b"}
Jul 21 12:57:48.241209 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.240884    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:57:48.242325 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.242299    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4" event={"ID":"664ad3f1-b529-4f38-b50b-e5ad2e4f32f6","Type":"ContainerStarted","Data":"9430e899ddb32c74dad1bda8eab58ead0f7f7c21177bb3f3b0b3c42a6fe7249d"}
Jul 21 12:57:48.242426 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.242358    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:48.280360 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.280314    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6" podStartSLOduration=2.329955408 podStartE2EDuration="8.280299998s" totalImagesPullingTime="5.95034459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:48.278244727 +0000 UTC m=+413.315274804" watchObservedRunningTime="2026-07-21 12:57:48.280299998 +0000 UTC m=+413.317330149"
Jul 21 12:57:48.310834 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:48.310770    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4" podStartSLOduration=1.8654276109999999 podStartE2EDuration="5.310756393s" totalImagesPullingTime="3.445328782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:57:48.307529515 +0000 UTC m=+413.344559586" watchObservedRunningTime="2026-07-21 12:57:48.310756393 +0000 UTC m=+413.347786466"
Jul 21 12:57:49.185848 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:49.185816    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:57:59.249639 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:59.249608    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6rzz4"
Jul 21 12:57:59.250141 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:57:59.249683    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:01.290304 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.290261    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"]
Jul 21 12:58:01.290721 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.290499    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" containerName="manager" containerID="cri-o://1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b" gracePeriod=2
Jul 21 12:58:01.295466 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:01.295426    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:01.296028 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.295988    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"]
Jul 21 12:58:01.314281 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.314250    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"]
Jul 21 12:58:01.314567 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.314518    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" containerName="manager" containerID="cri-o://8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec" gracePeriod=2
Jul 21 12:58:01.316884 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:01.316854    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6kmq6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:58:01.319092 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.319067    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"]
Jul 21 12:58:01.320442 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:01.320418    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:01.328912 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.328890    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:01.329289 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329273    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" containerName="manager"
Jul 21 12:58:01.329343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329292    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" containerName="manager"
Jul 21 12:58:01.329343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329302    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" containerName="manager"
Jul 21 12:58:01.329343 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329307    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" containerName="manager"
Jul 21 12:58:01.329442 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329362    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" containerName="manager"
Jul 21 12:58:01.329442 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.329370    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" containerName="manager"
Jul 21 12:58:01.332464 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.332445    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.335281 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:01.335256    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rxtw6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:01.348432 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.348406    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"]
Jul 21 12:58:01.357288 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.357264    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:01.365080 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.365061    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:01.374854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.374830    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"]
Jul 21 12:58:01.399742 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:01.399707    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6kmq6\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:58:01.466759 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.466729    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.466759 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.466762    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bchn\" (UniqueName: \"kubernetes.io/projected/f0a73de6-1040-4a73-aef8-72a116a2ede6-kube-api-access-4bchn\") pod \"limitador-operator-controller-manager-859d7b78bd-vxhxv\" (UID: \"f0a73de6-1040-4a73-aef8-72a116a2ede6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:01.466999 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.466880    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lqk\" (UniqueName: \"kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.567824 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.567800    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lqk\" (UniqueName: \"kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.567962 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.567882    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.567962 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.567912    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bchn\" (UniqueName: \"kubernetes.io/projected/f0a73de6-1040-4a73-aef8-72a116a2ede6-kube-api-access-4bchn\") pod \"limitador-operator-controller-manager-859d7b78bd-vxhxv\" (UID: \"f0a73de6-1040-4a73-aef8-72a116a2ede6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:01.568384 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.568359    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.579249 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.579222    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bchn\" (UniqueName: \"kubernetes.io/projected/f0a73de6-1040-4a73-aef8-72a116a2ede6-kube-api-access-4bchn\") pod \"limitador-operator-controller-manager-859d7b78bd-vxhxv\" (UID: \"f0a73de6-1040-4a73-aef8-72a116a2ede6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:01.579356 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.579283    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lqk\" (UniqueName: \"kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wfzzl\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.582534 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.582520    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:01.593961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.593944    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:58:01.720821 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.720793    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:01.727471 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.727458    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:01.770943 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.769640    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b899j\" (UniqueName: \"kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j\") pod \"cd6f957c-e583-4930-a834-c70a75a56ffc\" (UID: \"cd6f957c-e583-4930-a834-c70a75a56ffc\") "
Jul 21 12:58:01.770943 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.769688    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8rcf\" (UniqueName: \"kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf\") pod \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") "
Jul 21 12:58:01.770943 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.769734    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume\") pod \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\" (UID: \"aa780773-479d-4a3d-8e97-9ccfb7d4d786\") "
Jul 21 12:58:01.770943 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.770403    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa780773-479d-4a3d-8e97-9ccfb7d4d786" (UID: "aa780773-479d-4a3d-8e97-9ccfb7d4d786"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:58:01.772932 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.772902    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j" (OuterVolumeSpecName: "kube-api-access-b899j") pod "cd6f957c-e583-4930-a834-c70a75a56ffc" (UID: "cd6f957c-e583-4930-a834-c70a75a56ffc"). InnerVolumeSpecName "kube-api-access-b899j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:58:01.774796 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.774773    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf" (OuterVolumeSpecName: "kube-api-access-r8rcf") pod "aa780773-479d-4a3d-8e97-9ccfb7d4d786" (UID: "aa780773-479d-4a3d-8e97-9ccfb7d4d786"). InnerVolumeSpecName "kube-api-access-r8rcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:58:01.870401 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.870376    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b899j\" (UniqueName: \"kubernetes.io/projected/cd6f957c-e583-4930-a834-c70a75a56ffc-kube-api-access-b899j\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:01.870401 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.870401    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8rcf\" (UniqueName: \"kubernetes.io/projected/aa780773-479d-4a3d-8e97-9ccfb7d4d786-kube-api-access-r8rcf\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:01.870562 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.870410    2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa780773-479d-4a3d-8e97-9ccfb7d4d786-extensions-socket-volume\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:01.882217 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:01.882194    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10eabf4_f35e_4693_87ff_fc3b6dc03769.slice/crio-3f8eb7a2475f0124baa668138364966289db3b68133d0e873ff3d62e67f2346f WatchSource:0}: Error finding container 3f8eb7a2475f0124baa668138364966289db3b68133d0e873ff3d62e67f2346f: Status 404 returned error can't find the container with id 3f8eb7a2475f0124baa668138364966289db3b68133d0e873ff3d62e67f2346f
Jul 21 12:58:01.886522 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.886501    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:01.895758 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:01.895742    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"]
Jul 21 12:58:01.897403 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:01.897382    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a73de6_1040_4a73_aef8_72a116a2ede6.slice/crio-3e86c15bef79e9bc84023223f7e0c7bff1356da13a8e750c1f6005d466ee3d92 WatchSource:0}: Error finding container 3e86c15bef79e9bc84023223f7e0c7bff1356da13a8e750c1f6005d466ee3d92: Status 404 returned error can't find the container with id 3e86c15bef79e9bc84023223f7e0c7bff1356da13a8e750c1f6005d466ee3d92
Jul 21 12:58:02.318486 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.318459    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv" event={"ID":"f0a73de6-1040-4a73-aef8-72a116a2ede6","Type":"ContainerStarted","Data":"45c9e9f7437ac6374415e41663a3f2582787aff3d691a1d399eaf93f2f6eaec9"}
Jul 21 12:58:02.318884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.318525    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv" event={"ID":"f0a73de6-1040-4a73-aef8-72a116a2ede6","Type":"ContainerStarted","Data":"3e86c15bef79e9bc84023223f7e0c7bff1356da13a8e750c1f6005d466ee3d92"}
Jul 21 12:58:02.318884 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.318634    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:02.320208 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.320184    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" event={"ID":"c10eabf4-f35e-4693-87ff-fc3b6dc03769","Type":"ContainerStarted","Data":"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"}
Jul 21 12:58:02.320308 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.320234    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" event={"ID":"c10eabf4-f35e-4693-87ff-fc3b6dc03769","Type":"ContainerStarted","Data":"3f8eb7a2475f0124baa668138364966289db3b68133d0e873ff3d62e67f2346f"}
Jul 21 12:58:02.320308 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.320265    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:02.321501 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.321485    2532 generic.go:356] "Generic (PLEG): container finished" podID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" containerID="1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b" exitCode=0
Jul 21 12:58:02.321561 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.321528    2532 scope.go:117] "RemoveContainer" containerID="1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b"
Jul 21 12:58:02.321618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.321529    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rxtw6"
Jul 21 12:58:02.322989 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.322966    2532 generic.go:356] "Generic (PLEG): container finished" podID="cd6f957c-e583-4930-a834-c70a75a56ffc" containerID="8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec" exitCode=0
Jul 21 12:58:02.323087 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.322994    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6kmq6"
Jul 21 12:58:02.330618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.330602    2532 scope.go:117] "RemoveContainer" containerID="1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b"
Jul 21 12:58:02.330865 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:02.330848    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b\": container with ID starting with 1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b not found: ID does not exist" containerID="1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b"
Jul 21 12:58:02.330925 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.330875    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b"} err="failed to get container status \"1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b\": rpc error: code = NotFound desc = could not find container \"1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b\": container with ID starting with 1bf302fd905855dbc633c62614ce7527f07b842f12dc77ecde24e315a778502b not found: ID does not exist"
Jul 21 12:58:02.330925 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.330892    2532 scope.go:117] "RemoveContainer" containerID="8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec"
Jul 21 12:58:02.339118 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.339104    2532 scope.go:117] "RemoveContainer" containerID="8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec"
Jul 21 12:58:02.339372 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:02.339355    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec\": container with ID starting with 8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec not found: ID does not exist" containerID="8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec"
Jul 21 12:58:02.339436 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.339385    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec"} err="failed to get container status \"8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec\": rpc error: code = NotFound desc = could not find container \"8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec\": container with ID starting with 8f538d080487d21924c7bc4fe4ec860b6ccb7f7466433dc2e0638e0825cf70ec not found: ID does not exist"
Jul 21 12:58:02.420188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.420128    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" podStartSLOduration=1.420113752 podStartE2EDuration="1.420113752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:02.419549285 +0000 UTC m=+427.456579358" watchObservedRunningTime="2026-07-21 12:58:02.420113752 +0000 UTC m=+427.457143826"
Jul 21 12:58:02.420670 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.420506    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv" podStartSLOduration=1.420497404 podStartE2EDuration="1.420497404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:02.366661842 +0000 UTC m=+427.403691919" watchObservedRunningTime="2026-07-21 12:58:02.420497404 +0000 UTC m=+427.457527514"
Jul 21 12:58:02.632705 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.632628    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 12:58:02.637307 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.637290    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.654686 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.654659    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 12:58:02.777463 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.777434    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.777621 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.777483    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6f8\" (UniqueName: \"kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.878094 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.878065    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.878297 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.878126    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6f8\" (UniqueName: \"kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.878444 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.878426    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.894997 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.894940    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6f8\" (UniqueName: \"kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8\") pod \"kuadrant-operator-controller-manager-86878c769f-zdmbn\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:02.946824 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:02.946797    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:03.088908 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.088885    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 12:58:03.091267 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:03.091239    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1331bc_c0de_4a85_9c37_757eae31d11e.slice/crio-798b1e231c51a23754f70d41667839aee302d930c584002656980acdff011284 WatchSource:0}: Error finding container 798b1e231c51a23754f70d41667839aee302d930c584002656980acdff011284: Status 404 returned error can't find the container with id 798b1e231c51a23754f70d41667839aee302d930c584002656980acdff011284
Jul 21 12:58:03.330466 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.330428    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" event={"ID":"4d1331bc-c0de-4a85-9c37-757eae31d11e","Type":"ContainerStarted","Data":"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"}
Jul 21 12:58:03.330880 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.330487    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" event={"ID":"4d1331bc-c0de-4a85-9c37-757eae31d11e","Type":"ContainerStarted","Data":"798b1e231c51a23754f70d41667839aee302d930c584002656980acdff011284"}
Jul 21 12:58:03.330880 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.330517    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:03.353270 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.353225    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" podStartSLOduration=1.353208414 podStartE2EDuration="1.353208414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:03.351377569 +0000 UTC m=+428.388407642" watchObservedRunningTime="2026-07-21 12:58:03.353208414 +0000 UTC m=+428.390238516"
Jul 21 12:58:03.357937 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.357916    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa780773-479d-4a3d-8e97-9ccfb7d4d786" path="/var/lib/kubelet/pods/aa780773-479d-4a3d-8e97-9ccfb7d4d786/volumes"
Jul 21 12:58:03.358242 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:03.358229    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd6f957c-e583-4930-a834-c70a75a56ffc" path="/var/lib/kubelet/pods/cd6f957c-e583-4930-a834-c70a75a56ffc/volumes"
Jul 21 12:58:13.334338 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:13.334304    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxhxv"
Jul 21 12:58:13.334859 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:13.334489    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:14.339326 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.339299    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 12:58:14.405337 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.405307    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:14.405507 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.405474    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" podUID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" containerName="manager" containerID="cri-o://8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5" gracePeriod=10
Jul 21 12:58:14.659421 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.659401    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:14.673509 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.673484    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume\") pod \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") "
Jul 21 12:58:14.673615 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.673524    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82lqk\" (UniqueName: \"kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk\") pod \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\" (UID: \"c10eabf4-f35e-4693-87ff-fc3b6dc03769\") "
Jul 21 12:58:14.673840 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.673814    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c10eabf4-f35e-4693-87ff-fc3b6dc03769" (UID: "c10eabf4-f35e-4693-87ff-fc3b6dc03769"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 12:58:14.675749 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.675724    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk" (OuterVolumeSpecName: "kube-api-access-82lqk") pod "c10eabf4-f35e-4693-87ff-fc3b6dc03769" (UID: "c10eabf4-f35e-4693-87ff-fc3b6dc03769"). InnerVolumeSpecName "kube-api-access-82lqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:58:14.774791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.774758    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82lqk\" (UniqueName: \"kubernetes.io/projected/c10eabf4-f35e-4693-87ff-fc3b6dc03769-kube-api-access-82lqk\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:14.774791 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:14.774786    2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c10eabf4-f35e-4693-87ff-fc3b6dc03769-extensions-socket-volume\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:15.391648 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.391612    2532 generic.go:356] "Generic (PLEG): container finished" podID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" containerID="8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5" exitCode=0
Jul 21 12:58:15.392056 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.391663    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" event={"ID":"c10eabf4-f35e-4693-87ff-fc3b6dc03769","Type":"ContainerDied","Data":"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"}
Jul 21 12:58:15.392056 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.391728    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl" event={"ID":"c10eabf4-f35e-4693-87ff-fc3b6dc03769","Type":"ContainerDied","Data":"3f8eb7a2475f0124baa668138364966289db3b68133d0e873ff3d62e67f2346f"}
Jul 21 12:58:15.392056 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.391663    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"
Jul 21 12:58:15.392056 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.391746    2532 scope.go:117] "RemoveContainer" containerID="8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"
Jul 21 12:58:15.401220 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.401206    2532 scope.go:117] "RemoveContainer" containerID="8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"
Jul 21 12:58:15.401484 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:15.401461    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5\": container with ID starting with 8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5 not found: ID does not exist" containerID="8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"
Jul 21 12:58:15.401582 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.401490    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5"} err="failed to get container status \"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5\": rpc error: code = NotFound desc = could not find container \"8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5\": container with ID starting with 8a51f23312ed107847de32f1716317e54fa1935d37b98358823a9b6e18661ed5 not found: ID does not exist"
Jul 21 12:58:15.417727 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.417704    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:15.422138 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:15.422116    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wfzzl"]
Jul 21 12:58:17.357854 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:17.357783    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" path="/var/lib/kubelet/pods/c10eabf4-f35e-4693-87ff-fc3b6dc03769/volumes"
Jul 21 12:58:32.991080 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:32.991040    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:32.991657 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:32.991571    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" containerName="manager"
Jul 21 12:58:32.991657 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:32.991590    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" containerName="manager"
Jul 21 12:58:32.991778 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:32.991670    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10eabf4-f35e-4693-87ff-fc3b6dc03769" containerName="manager"
Jul 21 12:58:32.997973 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:32.997952    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.001132 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.001112    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 12:58:33.002299 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.002277    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s7px4\""
Jul 21 12:58:33.003568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.003547    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:33.087079 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.087038    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:33.120554 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.120521    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsxl\" (UniqueName: \"kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.120707 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.120568    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.221315 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.221274    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsxl\" (UniqueName: \"kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.221472 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.221332    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.221868 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.221852    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.231231 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.231202    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsxl\" (UniqueName: \"kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl\") pod \"limitador-limitador-64c94fd64f-x995j\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.308795 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.308732    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:33.449263 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.449237    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:33.451257 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:33.451229    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bea333_1c4e_4a6c_bad4_4c83ec6115a7.slice/crio-1a5dd140bf13820f08f5018f2cfda15e5a84910e85e866ead3547c370eb2e204 WatchSource:0}: Error finding container 1a5dd140bf13820f08f5018f2cfda15e5a84910e85e866ead3547c370eb2e204: Status 404 returned error can't find the container with id 1a5dd140bf13820f08f5018f2cfda15e5a84910e85e866ead3547c370eb2e204
Jul 21 12:58:33.483297 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.483269    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" event={"ID":"25bea333-1c4e-4a6c-bad4-4c83ec6115a7","Type":"ContainerStarted","Data":"1a5dd140bf13820f08f5018f2cfda15e5a84910e85e866ead3547c370eb2e204"}
Jul 21 12:58:33.856479 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.856443    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:33.861143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.861122    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:33.864188 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.864165    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-88scf\""
Jul 21 12:58:33.870332 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.870305    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:33.926526 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:33.926490    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cdv\" (UniqueName: \"kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv\") pod \"authorino-58cd955675-5j58r\" (UID: \"c9f03dbf-0708-4d91-94c6-72eacdb17242\") " pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:34.027961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:34.027925    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cdv\" (UniqueName: \"kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv\") pod \"authorino-58cd955675-5j58r\" (UID: \"c9f03dbf-0708-4d91-94c6-72eacdb17242\") " pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:34.038193 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:34.038140    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cdv\" (UniqueName: \"kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv\") pod \"authorino-58cd955675-5j58r\" (UID: \"c9f03dbf-0708-4d91-94c6-72eacdb17242\") " pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:34.172658 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:34.172560    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:34.366191 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:34.366121    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:34.367470 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:34.367432    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9f03dbf_0708_4d91_94c6_72eacdb17242.slice/crio-2f19e93cd1580928da62659a7478289edd712aeacfe975ea64a2ef7c3dd14782 WatchSource:0}: Error finding container 2f19e93cd1580928da62659a7478289edd712aeacfe975ea64a2ef7c3dd14782: Status 404 returned error can't find the container with id 2f19e93cd1580928da62659a7478289edd712aeacfe975ea64a2ef7c3dd14782
Jul 21 12:58:34.494089 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:34.494051    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5j58r" event={"ID":"c9f03dbf-0708-4d91-94c6-72eacdb17242","Type":"ContainerStarted","Data":"2f19e93cd1580928da62659a7478289edd712aeacfe975ea64a2ef7c3dd14782"}
Jul 21 12:58:36.512502 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:36.512459    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" event={"ID":"25bea333-1c4e-4a6c-bad4-4c83ec6115a7","Type":"ContainerStarted","Data":"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"}
Jul 21 12:58:36.512938 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:36.512645    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:36.528717 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:36.528656    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" podStartSLOduration=1.6434084260000001 podStartE2EDuration="4.528637762s" totalImagesPullingTime="2.885229336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:36.528484596 +0000 UTC m=+461.565514674" watchObservedRunningTime="2026-07-21 12:58:36.528637762 +0000 UTC m=+461.565667838"
Jul 21 12:58:38.492965 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:38.492938    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:38.530373 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:38.530342    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5j58r" event={"ID":"c9f03dbf-0708-4d91-94c6-72eacdb17242","Type":"ContainerStarted","Data":"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"}
Jul 21 12:58:38.548871 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:38.548831    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5j58r" podStartSLOduration=1.744910746 podStartE2EDuration="5.548818256s" totalImagesPullingTime="3.80390751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:58:38.54679737 +0000 UTC m=+463.583827446" watchObservedRunningTime="2026-07-21 12:58:38.548818256 +0000 UTC m=+463.585848330"
Jul 21 12:58:39.534761 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:39.534725    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5j58r" podUID="c9f03dbf-0708-4d91-94c6-72eacdb17242" containerName="authorino" containerID="cri-o://4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414" gracePeriod=30
Jul 21 12:58:39.786101 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:39.786047    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:39.880386 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:39.880361    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5cdv\" (UniqueName: \"kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv\") pod \"c9f03dbf-0708-4d91-94c6-72eacdb17242\" (UID: \"c9f03dbf-0708-4d91-94c6-72eacdb17242\") "
Jul 21 12:58:39.882480 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:39.882453    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv" (OuterVolumeSpecName: "kube-api-access-h5cdv") pod "c9f03dbf-0708-4d91-94c6-72eacdb17242" (UID: "c9f03dbf-0708-4d91-94c6-72eacdb17242"). InnerVolumeSpecName "kube-api-access-h5cdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:58:39.981645 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:39.981616    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5cdv\" (UniqueName: \"kubernetes.io/projected/c9f03dbf-0708-4d91-94c6-72eacdb17242-kube-api-access-h5cdv\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:40.541384 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.541348    2532 generic.go:356] "Generic (PLEG): container finished" podID="c9f03dbf-0708-4d91-94c6-72eacdb17242" containerID="4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414" exitCode=0
Jul 21 12:58:40.541858 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.541399    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5j58r"
Jul 21 12:58:40.541858 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.541411    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5j58r" event={"ID":"c9f03dbf-0708-4d91-94c6-72eacdb17242","Type":"ContainerDied","Data":"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"}
Jul 21 12:58:40.541858 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.541453    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5j58r" event={"ID":"c9f03dbf-0708-4d91-94c6-72eacdb17242","Type":"ContainerDied","Data":"2f19e93cd1580928da62659a7478289edd712aeacfe975ea64a2ef7c3dd14782"}
Jul 21 12:58:40.541858 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.541474    2532 scope.go:117] "RemoveContainer" containerID="4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"
Jul 21 12:58:40.550639 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.550623    2532 scope.go:117] "RemoveContainer" containerID="4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"
Jul 21 12:58:40.550883 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:40.550865    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414\": container with ID starting with 4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414 not found: ID does not exist" containerID="4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"
Jul 21 12:58:40.550961 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.550891    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414"} err="failed to get container status \"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414\": rpc error: code = NotFound desc = could not find container \"4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414\": container with ID starting with 4772396a2e640b7c97feddd8e263c470836ff26dd8dbd7f062d002b2a1314414 not found: ID does not exist"
Jul 21 12:58:40.564497 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.564476    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:40.567869 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:40.567852    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5j58r"]
Jul 21 12:58:41.358618 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:41.358586    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f03dbf-0708-4d91-94c6-72eacdb17242" path="/var/lib/kubelet/pods/c9f03dbf-0708-4d91-94c6-72eacdb17242/volumes"
Jul 21 12:58:47.520049 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:47.520009    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:49.508999 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:49.508964    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:49.509436 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:49.509135    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" podUID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" containerName="limitador" containerID="cri-o://30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755" gracePeriod=30
Jul 21 12:58:50.058467 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.058440    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:50.170418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.170346    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file\") pod \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") "
Jul 21 12:58:50.170418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.170403    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrsxl\" (UniqueName: \"kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl\") pod \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\" (UID: \"25bea333-1c4e-4a6c-bad4-4c83ec6115a7\") "
Jul 21 12:58:50.170746 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.170727    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file" (OuterVolumeSpecName: "config-file") pod "25bea333-1c4e-4a6c-bad4-4c83ec6115a7" (UID: "25bea333-1c4e-4a6c-bad4-4c83ec6115a7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 12:58:50.172499 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.172473    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl" (OuterVolumeSpecName: "kube-api-access-hrsxl") pod "25bea333-1c4e-4a6c-bad4-4c83ec6115a7" (UID: "25bea333-1c4e-4a6c-bad4-4c83ec6115a7"). InnerVolumeSpecName "kube-api-access-hrsxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:58:50.271418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.271390    2532 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-config-file\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:50.271418 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.271413    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrsxl\" (UniqueName: \"kubernetes.io/projected/25bea333-1c4e-4a6c-bad4-4c83ec6115a7-kube-api-access-hrsxl\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:58:50.602752 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.602721    2532 generic.go:356] "Generic (PLEG): container finished" podID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" containerID="30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755" exitCode=0
Jul 21 12:58:50.602752 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.602755    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" event={"ID":"25bea333-1c4e-4a6c-bad4-4c83ec6115a7","Type":"ContainerDied","Data":"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"}
Jul 21 12:58:50.603255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.602765    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j"
Jul 21 12:58:50.603255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.602792    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x995j" event={"ID":"25bea333-1c4e-4a6c-bad4-4c83ec6115a7","Type":"ContainerDied","Data":"1a5dd140bf13820f08f5018f2cfda15e5a84910e85e866ead3547c370eb2e204"}
Jul 21 12:58:50.603255 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.602813    2532 scope.go:117] "RemoveContainer" containerID="30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"
Jul 21 12:58:50.612463 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.612443    2532 scope.go:117] "RemoveContainer" containerID="30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"
Jul 21 12:58:50.612691 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:58:50.612674    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755\": container with ID starting with 30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755 not found: ID does not exist" containerID="30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"
Jul 21 12:58:50.612740 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.612698    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755"} err="failed to get container status \"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755\": rpc error: code = NotFound desc = could not find container \"30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755\": container with ID starting with 30a5e07f0273fe3ca619c1181fd86ac331d29190d556cf8660f4edda83eff755 not found: ID does not exist"
Jul 21 12:58:50.626973 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.626950    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:50.631807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:50.631786    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x995j"]
Jul 21 12:58:51.358936 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:51.358906    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" path="/var/lib/kubelet/pods/25bea333-1c4e-4a6c-bad4-4c83ec6115a7/volumes"
Jul 21 12:58:54.563542 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563510    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"]
Jul 21 12:58:54.563901 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563867    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" containerName="limitador"
Jul 21 12:58:54.563901 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563878    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" containerName="limitador"
Jul 21 12:58:54.563901 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563897    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f03dbf-0708-4d91-94c6-72eacdb17242" containerName="authorino"
Jul 21 12:58:54.563997 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563904    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f03dbf-0708-4d91-94c6-72eacdb17242" containerName="authorino"
Jul 21 12:58:54.563997 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563968    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f03dbf-0708-4d91-94c6-72eacdb17242" containerName="authorino"
Jul 21 12:58:54.563997 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.563979    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25bea333-1c4e-4a6c-bad4-4c83ec6115a7" containerName="limitador"
Jul 21 12:58:54.568474 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.568451    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.571877 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.571853    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 12:58:54.571999 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.571924    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 12:58:54.573354 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.573337    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lxqjz\""
Jul 21 12:58:54.573457 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.573338    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 12:58:54.581172 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.581136    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"]
Jul 21 12:58:54.706344 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.706307    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9eb18456-eed9-4f5e-b797-1252e50f75ca-data\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.706344 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.706348    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9tk\" (UniqueName: \"kubernetes.io/projected/9eb18456-eed9-4f5e-b797-1252e50f75ca-kube-api-access-fw9tk\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.806816 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.806779    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9eb18456-eed9-4f5e-b797-1252e50f75ca-data\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.806816 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.806819    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9tk\" (UniqueName: \"kubernetes.io/projected/9eb18456-eed9-4f5e-b797-1252e50f75ca-kube-api-access-fw9tk\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.807211 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.807192    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9eb18456-eed9-4f5e-b797-1252e50f75ca-data\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.815709 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.815646    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9tk\" (UniqueName: \"kubernetes.io/projected/9eb18456-eed9-4f5e-b797-1252e50f75ca-kube-api-access-fw9tk\") pod \"postgres-69fb4594cf-mr48d\" (UID: \"9eb18456-eed9-4f5e-b797-1252e50f75ca\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:54.879259 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:54.879227    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:58:55.045878 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:55.045850    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"]
Jul 21 12:58:55.047500 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:58:55.047473    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb18456_eed9_4f5e_b797_1252e50f75ca.slice/crio-ce5d565edcaef8331ced5630c98a5c4b1ced8050757bb99ae1afc6dd9b00c5e3 WatchSource:0}: Error finding container ce5d565edcaef8331ced5630c98a5c4b1ced8050757bb99ae1afc6dd9b00c5e3: Status 404 returned error can't find the container with id ce5d565edcaef8331ced5630c98a5c4b1ced8050757bb99ae1afc6dd9b00c5e3
Jul 21 12:58:55.630233 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:55.630127    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d" event={"ID":"9eb18456-eed9-4f5e-b797-1252e50f75ca","Type":"ContainerStarted","Data":"ce5d565edcaef8331ced5630c98a5c4b1ced8050757bb99ae1afc6dd9b00c5e3"}
Jul 21 12:58:59.755888 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:58:59.755861    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 12:59:00.659538 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:00.659499    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d" event={"ID":"9eb18456-eed9-4f5e-b797-1252e50f75ca","Type":"ContainerStarted","Data":"a5b62329022395b2317c583fd929c11bdfba1301439133edf502721e889f0ab2"}
Jul 21 12:59:00.659702 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:00.659574    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:59:00.679764 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:00.679715    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d" podStartSLOduration=1.975774001 podStartE2EDuration="6.679701716s" totalImagesPullingTime="4.703927715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:00.679120845 +0000 UTC m=+485.716150919" watchObservedRunningTime="2026-07-21 12:59:00.679701716 +0000 UTC m=+485.716731790"
Jul 21 12:59:06.695096 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:06.695070    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mr48d"
Jul 21 12:59:07.233558 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.233529    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:07.240919 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.240896    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:07.243754 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.243730    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-88scf\""
Jul 21 12:59:07.244695 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.244667    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:07.315946 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.315921    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2gx\" (UniqueName: \"kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx\") pod \"authorino-5d4b67c446-pnz5b\" (UID: \"52291ff1-60fc-4e66-8f42-733319fcb139\") " pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:07.417143 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.417115    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2gx\" (UniqueName: \"kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx\") pod \"authorino-5d4b67c446-pnz5b\" (UID: \"52291ff1-60fc-4e66-8f42-733319fcb139\") " pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:07.426107 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.426084    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2gx\" (UniqueName: \"kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx\") pod \"authorino-5d4b67c446-pnz5b\" (UID: \"52291ff1-60fc-4e66-8f42-733319fcb139\") " pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:07.453038 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.453010    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:07.453243 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.453230    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:07.486585 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.486532    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78fdd66c5-s2dmm"]
Jul 21 12:59:07.530968 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.530931    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fdd66c5-s2dmm"]
Jul 21 12:59:07.531112 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.531064    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.598197 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.598167    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78fdd66c5-s2dmm"]
Jul 21 12:59:07.598420 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:07.598403    2532 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4bxz5], unattached volumes=[], failed to process volumes=[kube-api-access-4bxz5]: context canceled" pod="kuadrant-system/authorino-78fdd66c5-s2dmm" podUID="de85d73a-07b2-41ec-be75-476451fb914c"
Jul 21 12:59:07.614298 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.614275    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:07.616539 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:59:07.616515    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52291ff1_60fc_4e66_8f42_733319fcb139.slice/crio-f40a1bb859af145cea17ce9e2b86d99bd131bd296cea0187f45280cdd122d7c6 WatchSource:0}: Error finding container f40a1bb859af145cea17ce9e2b86d99bd131bd296cea0187f45280cdd122d7c6: Status 404 returned error can't find the container with id f40a1bb859af145cea17ce9e2b86d99bd131bd296cea0187f45280cdd122d7c6
Jul 21 12:59:07.619555 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.619470    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxz5\" (UniqueName: \"kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5\") pod \"authorino-78fdd66c5-s2dmm\" (UID: \"de85d73a-07b2-41ec-be75-476451fb914c\") " pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.633187 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.633144    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 12:59:07.674391 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.674371    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 12:59:07.674481 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.674449    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.679198 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.679179    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 12:59:07.694412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.694389    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.694412 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.694396    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" event={"ID":"52291ff1-60fc-4e66-8f42-733319fcb139","Type":"ContainerStarted","Data":"f40a1bb859af145cea17ce9e2b86d99bd131bd296cea0187f45280cdd122d7c6"}
Jul 21 12:59:07.718198 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.718178    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.720309 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.720292    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.720379 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.720320    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnbnm\" (UniqueName: \"kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.720423 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.720377    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxz5\" (UniqueName: \"kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5\") pod \"authorino-78fdd66c5-s2dmm\" (UID: \"de85d73a-07b2-41ec-be75-476451fb914c\") " pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.738830 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.738772    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxz5\" (UniqueName: \"kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5\") pod \"authorino-78fdd66c5-s2dmm\" (UID: \"de85d73a-07b2-41ec-be75-476451fb914c\") " pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:07.820702 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.820656    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bxz5\" (UniqueName: \"kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5\") pod \"de85d73a-07b2-41ec-be75-476451fb914c\" (UID: \"de85d73a-07b2-41ec-be75-476451fb914c\") "
Jul 21 12:59:07.820876 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.820857    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.820957 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.820888    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbnm\" (UniqueName: \"kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.823008 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.822979    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5" (OuterVolumeSpecName: "kube-api-access-4bxz5") pod "de85d73a-07b2-41ec-be75-476451fb914c" (UID: "de85d73a-07b2-41ec-be75-476451fb914c"). InnerVolumeSpecName "kube-api-access-4bxz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:59:07.823346 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.823329    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.839750 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.839721    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbnm\" (UniqueName: \"kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm\") pod \"authorino-7d646f4859-8j2mh\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") " pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:07.921517 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.921481    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bxz5\" (UniqueName: \"kubernetes.io/projected/de85d73a-07b2-41ec-be75-476451fb914c-kube-api-access-4bxz5\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:59:07.983506 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:07.983472    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 12:59:08.172046 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.172023    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 12:59:08.183405 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:59:08.183373    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88971342_c55c_4c6c_ba62_65ef34620048.slice/crio-08e2b114214cc6783af116e81e51254e8b482c978514056247fd498d9a5db210 WatchSource:0}: Error finding container 08e2b114214cc6783af116e81e51254e8b482c978514056247fd498d9a5db210: Status 404 returned error can't find the container with id 08e2b114214cc6783af116e81e51254e8b482c978514056247fd498d9a5db210
Jul 21 12:59:08.700877 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.700846    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" event={"ID":"52291ff1-60fc-4e66-8f42-733319fcb139","Type":"ContainerStarted","Data":"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"}
Jul 21 12:59:08.701031 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.700912    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" podUID="52291ff1-60fc-4e66-8f42-733319fcb139" containerName="authorino" containerID="cri-o://3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578" gracePeriod=30
Jul 21 12:59:08.702103 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.702082    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d646f4859-8j2mh" event={"ID":"88971342-c55c-4c6c-ba62-65ef34620048","Type":"ContainerStarted","Data":"08e2b114214cc6783af116e81e51254e8b482c978514056247fd498d9a5db210"}
Jul 21 12:59:08.702201 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.702127    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fdd66c5-s2dmm"
Jul 21 12:59:08.722836 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.722750    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" podStartSLOduration=1.141775521 podStartE2EDuration="1.722731352s" totalImagesPullingTime="580.955831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:08.720439096 +0000 UTC m=+493.757469170" watchObservedRunningTime="2026-07-21 12:59:08.722731352 +0000 UTC m=+493.759761427"
Jul 21 12:59:08.758620 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.758598    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78fdd66c5-s2dmm"]
Jul 21 12:59:08.764688 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.764665    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78fdd66c5-s2dmm"]
Jul 21 12:59:08.973440 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:08.973385    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:09.034092 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.034060    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq2gx\" (UniqueName: \"kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx\") pod \"52291ff1-60fc-4e66-8f42-733319fcb139\" (UID: \"52291ff1-60fc-4e66-8f42-733319fcb139\") "
Jul 21 12:59:09.036197 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.036175    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx" (OuterVolumeSpecName: "kube-api-access-fq2gx") pod "52291ff1-60fc-4e66-8f42-733319fcb139" (UID: "52291ff1-60fc-4e66-8f42-733319fcb139"). InnerVolumeSpecName "kube-api-access-fq2gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:59:09.134654 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.134627    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq2gx\" (UniqueName: \"kubernetes.io/projected/52291ff1-60fc-4e66-8f42-733319fcb139-kube-api-access-fq2gx\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:59:09.358599 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.358526    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de85d73a-07b2-41ec-be75-476451fb914c" path="/var/lib/kubelet/pods/de85d73a-07b2-41ec-be75-476451fb914c/volumes"
Jul 21 12:59:09.708945 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.708915    2532 generic.go:356] "Generic (PLEG): container finished" podID="52291ff1-60fc-4e66-8f42-733319fcb139" containerID="3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578" exitCode=0
Jul 21 12:59:09.709128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.708960    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pnz5b"
Jul 21 12:59:09.709128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.708997    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" event={"ID":"52291ff1-60fc-4e66-8f42-733319fcb139","Type":"ContainerDied","Data":"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"}
Jul 21 12:59:09.709128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.709037    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pnz5b" event={"ID":"52291ff1-60fc-4e66-8f42-733319fcb139","Type":"ContainerDied","Data":"f40a1bb859af145cea17ce9e2b86d99bd131bd296cea0187f45280cdd122d7c6"}
Jul 21 12:59:09.709128 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.709061    2532 scope.go:117] "RemoveContainer" containerID="3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"
Jul 21 12:59:09.710629 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.710608    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d646f4859-8j2mh" event={"ID":"88971342-c55c-4c6c-ba62-65ef34620048","Type":"ContainerStarted","Data":"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"}
Jul 21 12:59:09.717792 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.717774    2532 scope.go:117] "RemoveContainer" containerID="3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"
Jul 21 12:59:09.718050 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:09.718030    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578\": container with ID starting with 3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578 not found: ID does not exist" containerID="3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"
Jul 21 12:59:09.718112 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.718056    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578"} err="failed to get container status \"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578\": rpc error: code = NotFound desc = could not find container \"3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578\": container with ID starting with 3aa82b4e75e8cfc005946dfa4fd36fdba58aed70c44f737708aa1da5a6796578 not found: ID does not exist"
Jul 21 12:59:09.732089 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.732047    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d646f4859-8j2mh" podStartSLOduration=2.210939197 podStartE2EDuration="2.732035497s" totalImagesPullingTime="521.0963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:09.731546742 +0000 UTC m=+494.768576818" watchObservedRunningTime="2026-07-21 12:59:09.732035497 +0000 UTC m=+494.769065588"
Jul 21 12:59:09.751478 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.751455    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:09.760910 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:09.760890    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pnz5b"]
Jul 21 12:59:11.358039 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:11.358010    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52291ff1-60fc-4e66-8f42-733319fcb139" path="/var/lib/kubelet/pods/52291ff1-60fc-4e66-8f42-733319fcb139/volumes"
Jul 21 12:59:14.446860 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.446812    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:14.447321 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.447182    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52291ff1-60fc-4e66-8f42-733319fcb139" containerName="authorino"
Jul 21 12:59:14.447321 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.447194    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="52291ff1-60fc-4e66-8f42-733319fcb139" containerName="authorino"
Jul 21 12:59:14.447321 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.447268    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="52291ff1-60fc-4e66-8f42-733319fcb139" containerName="authorino"
Jul 21 12:59:14.463634 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.463607    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:14.469571 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.469442    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 12:59:14.471193 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.471170    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 12:59:14.471193 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.471187    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5txpn\""
Jul 21 12:59:14.472491 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.472470    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:14.577346 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.577304    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5k9\" (UniqueName: \"kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:14.577524 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.577366    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:14.678137 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.678105    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:14.678319 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.678220    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5k9\" (UniqueName: \"kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:14.678319 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:14.678286    2532 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 12:59:14.678395 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:14.678353    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert podName:c27fa85f-01c3-426b-82bd-4b3ab17c5115 nodeName:}" failed. No retries permitted until 2026-07-21 12:59:15.178336162 +0000 UTC m=+500.215366214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert") pod "maas-controller-d699f866c-892j8" (UID: "c27fa85f-01c3-426b-82bd-4b3ab17c5115") : secret "maas-controller-webhook-cert" not found
Jul 21 12:59:14.693733 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:14.693699    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5k9\" (UniqueName: \"kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:15.182080 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:15.182044    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:15.182298 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:15.182240    2532 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 12:59:15.182356 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:15.182306    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert podName:c27fa85f-01c3-426b-82bd-4b3ab17c5115 nodeName:}" failed. No retries permitted until 2026-07-21 12:59:16.182291191 +0000 UTC m=+501.219321242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert") pod "maas-controller-d699f866c-892j8" (UID: "c27fa85f-01c3-426b-82bd-4b3ab17c5115") : secret "maas-controller-webhook-cert" not found
Jul 21 12:59:16.191132 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:16.191101    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:16.193673 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:16.193642    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"maas-controller-d699f866c-892j8\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") " pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:16.274988 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:16.274949    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:16.430083 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:16.430056    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:16.431530 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:59:16.431505    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27fa85f_01c3_426b_82bd_4b3ab17c5115.slice/crio-6006dfd5d6f008355e2c03109d23eaaa6aca31c2c904ec5fb91ed036a6186659 WatchSource:0}: Error finding container 6006dfd5d6f008355e2c03109d23eaaa6aca31c2c904ec5fb91ed036a6186659: Status 404 returned error can't find the container with id 6006dfd5d6f008355e2c03109d23eaaa6aca31c2c904ec5fb91ed036a6186659
Jul 21 12:59:16.748832 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:16.748794    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d699f866c-892j8" event={"ID":"c27fa85f-01c3-426b-82bd-4b3ab17c5115","Type":"ContainerStarted","Data":"6006dfd5d6f008355e2c03109d23eaaa6aca31c2c904ec5fb91ed036a6186659"}
Jul 21 12:59:18.760974 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:18.760946    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d699f866c-892j8" event={"ID":"c27fa85f-01c3-426b-82bd-4b3ab17c5115","Type":"ContainerStarted","Data":"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"}
Jul 21 12:59:18.761365 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:18.761009    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:18.784760 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:18.784700    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d699f866c-892j8" podStartSLOduration=2.626751495 podStartE2EDuration="4.784681857s" totalImagesPullingTime="2.157930362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:18.784208778 +0000 UTC m=+503.821238850" watchObservedRunningTime="2026-07-21 12:59:18.784681857 +0000 UTC m=+503.821711931"
Jul 21 12:59:29.768647 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:29.768622    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:30.129251 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.129175    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:30.129405 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.129358    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d699f866c-892j8" podUID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" containerName="manager" containerID="cri-o://77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f" gracePeriod=30
Jul 21 12:59:30.380756 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.380702    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:30.509600 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.509567    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf5k9\" (UniqueName: \"kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9\") pod \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") "
Jul 21 12:59:30.509814 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.509637    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") pod \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\" (UID: \"c27fa85f-01c3-426b-82bd-4b3ab17c5115\") "
Jul 21 12:59:30.512037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.511996    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9" (OuterVolumeSpecName: "kube-api-access-bf5k9") pod "c27fa85f-01c3-426b-82bd-4b3ab17c5115" (UID: "c27fa85f-01c3-426b-82bd-4b3ab17c5115"). InnerVolumeSpecName "kube-api-access-bf5k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 12:59:30.512037 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.512024    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c27fa85f-01c3-426b-82bd-4b3ab17c5115" (UID: "c27fa85f-01c3-426b-82bd-4b3ab17c5115"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 12:59:30.610387 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.610351    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf5k9\" (UniqueName: \"kubernetes.io/projected/c27fa85f-01c3-426b-82bd-4b3ab17c5115-kube-api-access-bf5k9\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:59:30.610387 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.610380    2532 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27fa85f-01c3-426b-82bd-4b3ab17c5115-webhook-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 12:59:30.831424 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.831390    2532 generic.go:356] "Generic (PLEG): container finished" podID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" containerID="77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f" exitCode=0
Jul 21 12:59:30.831807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.831439    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d699f866c-892j8"
Jul 21 12:59:30.831807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.831466    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d699f866c-892j8" event={"ID":"c27fa85f-01c3-426b-82bd-4b3ab17c5115","Type":"ContainerDied","Data":"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"}
Jul 21 12:59:30.831807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.831522    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d699f866c-892j8" event={"ID":"c27fa85f-01c3-426b-82bd-4b3ab17c5115","Type":"ContainerDied","Data":"6006dfd5d6f008355e2c03109d23eaaa6aca31c2c904ec5fb91ed036a6186659"}
Jul 21 12:59:30.831807 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.831546    2532 scope.go:117] "RemoveContainer" containerID="77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"
Jul 21 12:59:30.841333 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.841315    2532 scope.go:117] "RemoveContainer" containerID="77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"
Jul 21 12:59:30.841601 ip-10-0-140-67 kubenswrapper[2532]: E0721 12:59:30.841583    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f\": container with ID starting with 77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f not found: ID does not exist" containerID="77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"
Jul 21 12:59:30.841648 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.841611    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f"} err="failed to get container status \"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f\": rpc error: code = NotFound desc = could not find container \"77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f\": container with ID starting with 77d69a385923401128d4abff438b18f18e1adb5e9d64ba0317591ee392dc6d9f not found: ID does not exist"
Jul 21 12:59:30.854092 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.854063    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:30.858289 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:30.858262    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d699f866c-892j8"]
Jul 21 12:59:31.359336 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:31.359299    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" path="/var/lib/kubelet/pods/c27fa85f-01c3-426b-82bd-4b3ab17c5115/volumes"
Jul 21 12:59:49.627512 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.627391    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-594665875c-p9hq8"]
Jul 21 12:59:49.628094 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.627966    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" containerName="manager"
Jul 21 12:59:49.628094 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.627985    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" containerName="manager"
Jul 21 12:59:49.628094 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.628088    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27fa85f-01c3-426b-82bd-4b3ab17c5115" containerName="manager"
Jul 21 12:59:49.636199 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.636179    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.639187 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.639141    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pkltq\""
Jul 21 12:59:49.639365 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.639141    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 12:59:49.639957 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.639938    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-594665875c-p9hq8"]
Jul 21 12:59:49.770681 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.770647    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50f855bf-2666-436c-a1f6-840bf22c0484-maas-api-tls\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.770681 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.770684    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2tm\" (UniqueName: \"kubernetes.io/projected/50f855bf-2666-436c-a1f6-840bf22c0484-kube-api-access-wk2tm\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.770912 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.770712    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f855bf-2666-436c-a1f6-840bf22c0484-openshift-service-ca\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.871334 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.871302    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50f855bf-2666-436c-a1f6-840bf22c0484-maas-api-tls\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.871334 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.871337    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2tm\" (UniqueName: \"kubernetes.io/projected/50f855bf-2666-436c-a1f6-840bf22c0484-kube-api-access-wk2tm\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.871565 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.871354    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f855bf-2666-436c-a1f6-840bf22c0484-openshift-service-ca\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.872022 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.871954    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f855bf-2666-436c-a1f6-840bf22c0484-openshift-service-ca\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.874021 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.874000    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50f855bf-2666-436c-a1f6-840bf22c0484-maas-api-tls\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.880866 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.880814    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2tm\" (UniqueName: \"kubernetes.io/projected/50f855bf-2666-436c-a1f6-840bf22c0484-kube-api-access-wk2tm\") pod \"maas-api-594665875c-p9hq8\" (UID: \"50f855bf-2666-436c-a1f6-840bf22c0484\") " pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:49.948324 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:49.948299    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:50.105397 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.105372    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-594665875c-p9hq8"]
Jul 21 12:59:50.107772 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:59:50.107746    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f855bf_2666_436c_a1f6_840bf22c0484.slice/crio-8f52a31d40356447c939d19f018557289afa8d03f0519fbd36fe6b1336fafa71 WatchSource:0}: Error finding container 8f52a31d40356447c939d19f018557289afa8d03f0519fbd36fe6b1336fafa71: Status 404 returned error can't find the container with id 8f52a31d40356447c939d19f018557289afa8d03f0519fbd36fe6b1336fafa71
Jul 21 12:59:50.329446 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.329409    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zspzq"]
Jul 21 12:59:50.334675 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.334654    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.338640 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.338615    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 12:59:50.338769 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.338743    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9bfjm\""
Jul 21 12:59:50.342857 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.342772    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zspzq"]
Jul 21 12:59:50.476568 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.476531    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54914c2e-4bb9-4317-bf24-2a3a401ad507-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.476731 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.476596    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtdd\" (UniqueName: \"kubernetes.io/projected/54914c2e-4bb9-4317-bf24-2a3a401ad507-kube-api-access-sjtdd\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.577213 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.577170    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54914c2e-4bb9-4317-bf24-2a3a401ad507-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.577379 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.577243    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtdd\" (UniqueName: \"kubernetes.io/projected/54914c2e-4bb9-4317-bf24-2a3a401ad507-kube-api-access-sjtdd\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.577861 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.577842    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54914c2e-4bb9-4317-bf24-2a3a401ad507-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.594301 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.594234    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtdd\" (UniqueName: \"kubernetes.io/projected/54914c2e-4bb9-4317-bf24-2a3a401ad507-kube-api-access-sjtdd\") pod \"payload-pre-processing-7677b774bb-zspzq\" (UID: \"54914c2e-4bb9-4317-bf24-2a3a401ad507\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.647371 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.647343    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:50.938576 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.938491    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8" event={"ID":"50f855bf-2666-436c-a1f6-840bf22c0484","Type":"ContainerStarted","Data":"8f52a31d40356447c939d19f018557289afa8d03f0519fbd36fe6b1336fafa71"}
Jul 21 12:59:50.991781 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:50.991754    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zspzq"]
Jul 21 12:59:50.993417 ip-10-0-140-67 kubenswrapper[2532]: W0721 12:59:50.993387    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54914c2e_4bb9_4317_bf24_2a3a401ad507.slice/crio-775dc33028921ed2cd872d59d3baca9ef08d4857c8e48dd976d88fe4e38419a3 WatchSource:0}: Error finding container 775dc33028921ed2cd872d59d3baca9ef08d4857c8e48dd976d88fe4e38419a3: Status 404 returned error can't find the container with id 775dc33028921ed2cd872d59d3baca9ef08d4857c8e48dd976d88fe4e38419a3
Jul 21 12:59:51.948575 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:51.948542    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8" event={"ID":"50f855bf-2666-436c-a1f6-840bf22c0484","Type":"ContainerStarted","Data":"5f5d27db3daee74d0a395ff0a5df1082ea9208091e8ed7c30cd3f0821ddbca26"}
Jul 21 12:59:51.949054 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:51.948630    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 12:59:51.950581 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:51.950528    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq" event={"ID":"54914c2e-4bb9-4317-bf24-2a3a401ad507","Type":"ContainerStarted","Data":"775dc33028921ed2cd872d59d3baca9ef08d4857c8e48dd976d88fe4e38419a3"}
Jul 21 12:59:51.969469 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:51.969419    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8" podStartSLOduration=1.487484288 podStartE2EDuration="2.9693997s" totalImagesPullingTime="1.481915412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:51.966287684 +0000 UTC m=+537.003317762" watchObservedRunningTime="2026-07-21 12:59:51.9693997 +0000 UTC m=+537.006429776"
Jul 21 12:59:52.958655 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:52.958612    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq" event={"ID":"54914c2e-4bb9-4317-bf24-2a3a401ad507","Type":"ContainerStarted","Data":"613893f6c96905f95114f79d4887b0d307911a7b6b85e3233a7ef44cc7306e95"}
Jul 21 12:59:52.959110 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:52.958869    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 12:59:52.982480 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:52.982428    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq" podStartSLOduration=1.3413270609999999 podStartE2EDuration="2.982411283s" totalImagesPullingTime="1.641084222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 12:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 12:59:52.980820958 +0000 UTC m=+538.017851035" watchObservedRunningTime="2026-07-21 12:59:52.982411283 +0000 UTC m=+538.019441356"
Jul 21 12:59:57.965383 ip-10-0-140-67 kubenswrapper[2532]: I0721 12:59:57.965353    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-594665875c-p9hq8"
Jul 21 13:00:00.161131 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.161098    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"]
Jul 21 13:00:00.165952 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.165933    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"
Jul 21 13:00:00.170744 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.170727    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:00:00.175201 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.175183    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"
Jul 21 13:00:00.189024 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.189004    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"]
Jul 21 13:00:00.321082 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:00.321053    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"]
Jul 21 13:00:00.323096 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:00:00.322975    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bf81e0_43cc_4238_bfec_b9a96da01f15.slice/crio-c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd WatchSource:0}: Error finding container c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd: Status 404 returned error can't find the container with id c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd
Jul 21 13:00:01.002664 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:01.002631    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb" event={"ID":"f4bf81e0-43cc-4238-bfec-b9a96da01f15","Type":"ContainerStarted","Data":"c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd"}
Jul 21 13:00:03.965811 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:03.965782    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zspzq"
Jul 21 13:00:07.035493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:07.035456    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb" event={"ID":"f4bf81e0-43cc-4238-bfec-b9a96da01f15","Type":"ContainerStarted","Data":"f2b3506abdc06ecc955e79cbfba3915c601bd96ea4deffbcd92d3f48feb11a9f"}
Jul 21 13:00:07.054128 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:07.054079    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb" podStartSLOduration=0.814208506 podStartE2EDuration="7.054065203s" totalImagesPullingTime="6.239856697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:00:07.052971243 +0000 UTC m=+552.090001317" watchObservedRunningTime="2026-07-21 13:00:07.054065203 +0000 UTC m=+552.091095315"
Jul 21 13:00:08.042253 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:08.042219    2532 generic.go:356] "Generic (PLEG): container finished" podID="f4bf81e0-43cc-4238-bfec-b9a96da01f15" containerID="f2b3506abdc06ecc955e79cbfba3915c601bd96ea4deffbcd92d3f48feb11a9f" exitCode=0
Jul 21 13:00:08.042629 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:08.042310    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb" event={"ID":"f4bf81e0-43cc-4238-bfec-b9a96da01f15","Type":"ContainerDied","Data":"f2b3506abdc06ecc955e79cbfba3915c601bd96ea4deffbcd92d3f48feb11a9f"}
Jul 21 13:00:09.183453 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:09.183425    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"
Jul 21 13:00:10.054172 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:10.054129    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb"
Jul 21 13:00:10.054325 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:10.054182    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743980-hphtb" event={"ID":"f4bf81e0-43cc-4238-bfec-b9a96da01f15","Type":"ContainerDied","Data":"c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd"}
Jul 21 13:00:10.054325 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:10.054253    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7b9a2ddab0b244e23f200536cd82d1196c1f21670dd72da6d1442a0c52aeabd"
Jul 21 13:00:16.428021 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.427981    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"]
Jul 21 13:00:16.428599 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.428582    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4bf81e0-43cc-4238-bfec-b9a96da01f15" containerName="cleanup"
Jul 21 13:00:16.428662 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.428603    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4bf81e0-43cc-4238-bfec-b9a96da01f15" containerName="cleanup"
Jul 21 13:00:16.428714 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.428704    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4bf81e0-43cc-4238-bfec-b9a96da01f15" containerName="cleanup"
Jul 21 13:00:16.432267 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.432248    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.435254 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.435230    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 13:00:16.435365 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.435296    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 13:00:16.436796 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.436775    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dv5rb\""
Jul 21 13:00:16.436919 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.436892    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 13:00:16.440875 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.440854    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"]
Jul 21 13:00:16.490843 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.490817    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.491002 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.490855    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vcs8\" (UniqueName: \"kubernetes.io/projected/564ff6bd-62c7-4527-a5ac-5600d13fb45c-kube-api-access-6vcs8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.491002 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.490888    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.491002 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.490975    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.491162 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.491032    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.491162 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.491066    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591595 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591571    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591745 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591602    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591745 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591624    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591745 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591645    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vcs8\" (UniqueName: \"kubernetes.io/projected/564ff6bd-62c7-4527-a5ac-5600d13fb45c-kube-api-access-6vcs8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591904 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591784    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.591904 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.591864    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.592040 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.592022    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.592096 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.592078    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.592139 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.592124    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.594121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.594095    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564ff6bd-62c7-4527-a5ac-5600d13fb45c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.594269 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.594252    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564ff6bd-62c7-4527-a5ac-5600d13fb45c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.600843 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.600816    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vcs8\" (UniqueName: \"kubernetes.io/projected/564ff6bd-62c7-4527-a5ac-5600d13fb45c-kube-api-access-6vcs8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t\" (UID: \"564ff6bd-62c7-4527-a5ac-5600d13fb45c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.744320 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.744291    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:00:16.889588 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:16.889559    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"]
Jul 21 13:00:16.892163 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:00:16.892110    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564ff6bd_62c7_4527_a5ac_5600d13fb45c.slice/crio-f215c9fb95fc998d018cbd9bfaa9e75ff493c0b9e0955102a6e89953801f7496 WatchSource:0}: Error finding container f215c9fb95fc998d018cbd9bfaa9e75ff493c0b9e0955102a6e89953801f7496: Status 404 returned error can't find the container with id f215c9fb95fc998d018cbd9bfaa9e75ff493c0b9e0955102a6e89953801f7496
Jul 21 13:00:17.094816 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:17.094721    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t" event={"ID":"564ff6bd-62c7-4527-a5ac-5600d13fb45c","Type":"ContainerStarted","Data":"f215c9fb95fc998d018cbd9bfaa9e75ff493c0b9e0955102a6e89953801f7496"}
Jul 21 13:00:55.316481 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:55.316455    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:00:55.317463 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:00:55.317442    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:01:01.333768 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:01.333726    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t" event={"ID":"564ff6bd-62c7-4527-a5ac-5600d13fb45c","Type":"ContainerStarted","Data":"9688f9e06c158b6bd428d4bf3933374945f07609c9ffb93cd660931c6f7ab404"}
Jul 21 13:01:01.354642 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:01.354598    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t" podStartSLOduration=1.119800444 podStartE2EDuration="45.354583836s" totalImagesPullingTime="44.234783392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:01:01.353023931 +0000 UTC m=+606.390054017" watchObservedRunningTime="2026-07-21 13:01:01.354583836 +0000 UTC m=+606.391613912"
Jul 21 13:01:06.744397 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:06.744364    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:01:06.744760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:06.744452    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:01:06.757214 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:06.757191    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:01:07.377883 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:01:07.377857    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t"
Jul 21 13:02:11.434611 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.434565    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f6f8d8d6-gllrp"]
Jul 21 13:02:11.438226 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.438208    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.446384 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.446361    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f6f8d8d6-gllrp"]
Jul 21 13:02:11.465528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.465504    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63d29853-9fe4-4f58-925c-bcaea23f2b8c-tls-cert\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.465623 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.465574    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqg6\" (UniqueName: \"kubernetes.io/projected/63d29853-9fe4-4f58-925c-bcaea23f2b8c-kube-api-access-jdqg6\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.566016 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.565990    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63d29853-9fe4-4f58-925c-bcaea23f2b8c-tls-cert\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.566171 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.566056    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqg6\" (UniqueName: \"kubernetes.io/projected/63d29853-9fe4-4f58-925c-bcaea23f2b8c-kube-api-access-jdqg6\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.568656 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.568635    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63d29853-9fe4-4f58-925c-bcaea23f2b8c-tls-cert\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.575543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.575520    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqg6\" (UniqueName: \"kubernetes.io/projected/63d29853-9fe4-4f58-925c-bcaea23f2b8c-kube-api-access-jdqg6\") pod \"authorino-9f6f8d8d6-gllrp\" (UID: \"63d29853-9fe4-4f58-925c-bcaea23f2b8c\") " pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.748866 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.748841    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f6f8d8d6-gllrp"
Jul 21 13:02:11.895090 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.895061    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f6f8d8d6-gllrp"]
Jul 21 13:02:11.896565 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:02:11.896538    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63d29853_9fe4_4f58_925c_bcaea23f2b8c.slice/crio-ce4ad1c06d6542db9fe3171b89c154a180c2674309a09338b0e4f31ac4f936be WatchSource:0}: Error finding container ce4ad1c06d6542db9fe3171b89c154a180c2674309a09338b0e4f31ac4f936be: Status 404 returned error can't find the container with id ce4ad1c06d6542db9fe3171b89c154a180c2674309a09338b0e4f31ac4f936be
Jul 21 13:02:11.897950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:11.897921    2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 13:02:12.706070 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:12.706034    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f6f8d8d6-gllrp" event={"ID":"63d29853-9fe4-4f58-925c-bcaea23f2b8c","Type":"ContainerStarted","Data":"ce4ad1c06d6542db9fe3171b89c154a180c2674309a09338b0e4f31ac4f936be"}
Jul 21 13:02:13.715750 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:13.715715    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f6f8d8d6-gllrp" event={"ID":"63d29853-9fe4-4f58-925c-bcaea23f2b8c","Type":"ContainerStarted","Data":"a21901064e0dfdbd1b45a0f465abbc90f33c5f369a941afd6db0e3254338595b"}
Jul 21 13:02:13.740459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:13.740401    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9f6f8d8d6-gllrp" podStartSLOduration=1.761070441 podStartE2EDuration="2.740380542s" totalImagesPullingTime="979.310101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:02:13.740097946 +0000 UTC m=+678.777128024" watchObservedRunningTime="2026-07-21 13:02:13.740380542 +0000 UTC m=+678.777410623"
Jul 21 13:02:13.772462 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:13.772430    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 13:02:13.772661 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:13.772617    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d646f4859-8j2mh" podUID="88971342-c55c-4c6c-ba62-65ef34620048" containerName="authorino" containerID="cri-o://f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3" gracePeriod=30
Jul 21 13:02:14.048674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.048641    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 13:02:14.086341 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.086302    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnbnm\" (UniqueName: \"kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm\") pod \"88971342-c55c-4c6c-ba62-65ef34620048\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") "
Jul 21 13:02:14.086533 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.086379    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert\") pod \"88971342-c55c-4c6c-ba62-65ef34620048\" (UID: \"88971342-c55c-4c6c-ba62-65ef34620048\") "
Jul 21 13:02:14.088679 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.088649    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm" (OuterVolumeSpecName: "kube-api-access-dnbnm") pod "88971342-c55c-4c6c-ba62-65ef34620048" (UID: "88971342-c55c-4c6c-ba62-65ef34620048"). InnerVolumeSpecName "kube-api-access-dnbnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:02:14.097862 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.097751    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "88971342-c55c-4c6c-ba62-65ef34620048" (UID: "88971342-c55c-4c6c-ba62-65ef34620048"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:02:14.187944 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.187915    2532 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88971342-c55c-4c6c-ba62-65ef34620048-tls-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:02:14.187944 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.187945    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnbnm\" (UniqueName: \"kubernetes.io/projected/88971342-c55c-4c6c-ba62-65ef34620048-kube-api-access-dnbnm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:02:14.729979 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.729929    2532 generic.go:356] "Generic (PLEG): container finished" podID="88971342-c55c-4c6c-ba62-65ef34620048" containerID="f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3" exitCode=0
Jul 21 13:02:14.729979 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.729979    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d646f4859-8j2mh"
Jul 21 13:02:14.730526 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.729983    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d646f4859-8j2mh" event={"ID":"88971342-c55c-4c6c-ba62-65ef34620048","Type":"ContainerDied","Data":"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"}
Jul 21 13:02:14.730526 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.730028    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d646f4859-8j2mh" event={"ID":"88971342-c55c-4c6c-ba62-65ef34620048","Type":"ContainerDied","Data":"08e2b114214cc6783af116e81e51254e8b482c978514056247fd498d9a5db210"}
Jul 21 13:02:14.730526 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.730052    2532 scope.go:117] "RemoveContainer" containerID="f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"
Jul 21 13:02:14.740747 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.740722    2532 scope.go:117] "RemoveContainer" containerID="f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"
Jul 21 13:02:14.741043 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:02:14.741018    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3\": container with ID starting with f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3 not found: ID does not exist" containerID="f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"
Jul 21 13:02:14.741103 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.741057    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3"} err="failed to get container status \"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3\": rpc error: code = NotFound desc = could not find container \"f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3\": container with ID starting with f24792106837d817f6e30b20251fff85d541c1b61a6a7ff147b738136cbd19b3 not found: ID does not exist"
Jul 21 13:02:14.755964 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.755936    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 13:02:14.761970 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:14.761943    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d646f4859-8j2mh"]
Jul 21 13:02:15.360466 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:02:15.360432    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88971342-c55c-4c6c-ba62-65ef34620048" path="/var/lib/kubelet/pods/88971342-c55c-4c6c-ba62-65ef34620048/volumes"
Jul 21 13:04:25.296212 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.296111    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:25.296667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.296562    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88971342-c55c-4c6c-ba62-65ef34620048" containerName="authorino"
Jul 21 13:04:25.296667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.296576    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="88971342-c55c-4c6c-ba62-65ef34620048" containerName="authorino"
Jul 21 13:04:25.296667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.296644    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="88971342-c55c-4c6c-ba62-65ef34620048" containerName="authorino"
Jul 21 13:04:25.299805 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.299789    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.304141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.304117    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5txpn\""
Jul 21 13:04:25.304287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.304121    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 13:04:25.304287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.304206    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 13:04:25.309361 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.309343    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:25.385357 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.385329    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.385537 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.385398    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9wg8\" (UniqueName: \"kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.486741 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.486704    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.486917 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.486765    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9wg8\" (UniqueName: \"kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.489299 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.489282    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.497303 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.497277    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9wg8\" (UniqueName: \"kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8\") pod \"maas-controller-688696d74-8kx8w\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") " pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.611013 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.610920    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:25.756552 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:25.756529    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:25.759306 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:04:25.759280    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07172f4_bee8_4908_9524_38c1c269d430.slice/crio-dc541d3ea1508d79df01ba9598b2bc06427dd85c3e39ac823b29fafa137e4a5e WatchSource:0}: Error finding container dc541d3ea1508d79df01ba9598b2bc06427dd85c3e39ac823b29fafa137e4a5e: Status 404 returned error can't find the container with id dc541d3ea1508d79df01ba9598b2bc06427dd85c3e39ac823b29fafa137e4a5e
Jul 21 13:04:26.444334 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:26.444306    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-8kx8w" event={"ID":"a07172f4-bee8-4908-9524-38c1c269d430","Type":"ContainerStarted","Data":"dc541d3ea1508d79df01ba9598b2bc06427dd85c3e39ac823b29fafa137e4a5e"}
Jul 21 13:04:27.451343 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:27.451311    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-8kx8w" event={"ID":"a07172f4-bee8-4908-9524-38c1c269d430","Type":"ContainerStarted","Data":"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"}
Jul 21 13:04:27.451779 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:27.451392    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:27.473214 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:27.473169    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-688696d74-8kx8w" podStartSLOduration=1.79718138 podStartE2EDuration="2.473139678s" totalImagesPullingTime="675.958298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:04:27.469972345 +0000 UTC m=+812.507002420" watchObservedRunningTime="2026-07-21 13:04:27.473139678 +0000 UTC m=+812.510169777"
Jul 21 13:04:38.458800 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:38.458773    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:43.263837 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.263802    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:43.264511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.264016    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-688696d74-8kx8w" podUID="a07172f4-bee8-4908-9524-38c1c269d430" containerName="manager" containerID="cri-o://af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724" gracePeriod=30
Jul 21 13:04:43.513992 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.513936    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:43.536540 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.536509    2532 generic.go:356] "Generic (PLEG): container finished" podID="a07172f4-bee8-4908-9524-38c1c269d430" containerID="af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724" exitCode=0
Jul 21 13:04:43.536674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.536563    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-8kx8w" event={"ID":"a07172f4-bee8-4908-9524-38c1c269d430","Type":"ContainerDied","Data":"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"}
Jul 21 13:04:43.536674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.536577    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-8kx8w"
Jul 21 13:04:43.536674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.536610    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-8kx8w" event={"ID":"a07172f4-bee8-4908-9524-38c1c269d430","Type":"ContainerDied","Data":"dc541d3ea1508d79df01ba9598b2bc06427dd85c3e39ac823b29fafa137e4a5e"}
Jul 21 13:04:43.536674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.536640    2532 scope.go:117] "RemoveContainer" containerID="af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"
Jul 21 13:04:43.547437 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.547416    2532 scope.go:117] "RemoveContainer" containerID="af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"
Jul 21 13:04:43.547750 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:04:43.547724    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724\": container with ID starting with af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724 not found: ID does not exist" containerID="af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"
Jul 21 13:04:43.547853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.547760    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724"} err="failed to get container status \"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724\": rpc error: code = NotFound desc = could not find container \"af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724\": container with ID starting with af0aad5f4cb584f3d388f8793a3c8fb7b442ce1fff0d2d23419df95137303724 not found: ID does not exist"
Jul 21 13:04:43.644913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.644883    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9wg8\" (UniqueName: \"kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8\") pod \"a07172f4-bee8-4908-9524-38c1c269d430\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") "
Jul 21 13:04:43.645066 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.644992    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert\") pod \"a07172f4-bee8-4908-9524-38c1c269d430\" (UID: \"a07172f4-bee8-4908-9524-38c1c269d430\") "
Jul 21 13:04:43.647063 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.647030    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a07172f4-bee8-4908-9524-38c1c269d430" (UID: "a07172f4-bee8-4908-9524-38c1c269d430"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:04:43.647063 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.647053    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8" (OuterVolumeSpecName: "kube-api-access-x9wg8") pod "a07172f4-bee8-4908-9524-38c1c269d430" (UID: "a07172f4-bee8-4908-9524-38c1c269d430"). InnerVolumeSpecName "kube-api-access-x9wg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:04:43.746174 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.746127    2532 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a07172f4-bee8-4908-9524-38c1c269d430-webhook-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:04:43.746174 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.746171    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9wg8\" (UniqueName: \"kubernetes.io/projected/a07172f4-bee8-4908-9524-38c1c269d430-kube-api-access-x9wg8\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:04:43.859725 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.859700    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:43.863767 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:43.863741    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-688696d74-8kx8w"]
Jul 21 13:04:44.889305 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.889255    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688696d74-k6bs8"]
Jul 21 13:04:44.889716 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.889614    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07172f4-bee8-4908-9524-38c1c269d430" containerName="manager"
Jul 21 13:04:44.889716 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.889624    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07172f4-bee8-4908-9524-38c1c269d430" containerName="manager"
Jul 21 13:04:44.889716 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.889686    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07172f4-bee8-4908-9524-38c1c269d430" containerName="manager"
Jul 21 13:04:44.893922 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.893906    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:44.897331 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.897307    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 13:04:44.898669 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.898648    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 13:04:44.903839 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.898890    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5txpn\""
Jul 21 13:04:44.905329 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.905310    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688696d74-k6bs8"]
Jul 21 13:04:44.957545 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.957515    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c548be2-4f91-4c35-bce1-7782151ea23f-webhook-cert\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:44.957723 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:44.957567    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7c6\" (UniqueName: \"kubernetes.io/projected/5c548be2-4f91-4c35-bce1-7782151ea23f-kube-api-access-6p7c6\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.058068 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.058034    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7c6\" (UniqueName: \"kubernetes.io/projected/5c548be2-4f91-4c35-bce1-7782151ea23f-kube-api-access-6p7c6\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.058225 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.058113    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c548be2-4f91-4c35-bce1-7782151ea23f-webhook-cert\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.060536 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.060507    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c548be2-4f91-4c35-bce1-7782151ea23f-webhook-cert\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.067945 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.067912    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7c6\" (UniqueName: \"kubernetes.io/projected/5c548be2-4f91-4c35-bce1-7782151ea23f-kube-api-access-6p7c6\") pod \"maas-controller-688696d74-k6bs8\" (UID: \"5c548be2-4f91-4c35-bce1-7782151ea23f\") " pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.211526 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.211491    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:45.347605 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.347581    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688696d74-k6bs8"]
Jul 21 13:04:45.349188 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:04:45.349143    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c548be2_4f91_4c35_bce1_7782151ea23f.slice/crio-e730b9efe8028f63d83ae3f777bd475471b59e701591de4fd8a06651cae3e86a WatchSource:0}: Error finding container e730b9efe8028f63d83ae3f777bd475471b59e701591de4fd8a06651cae3e86a: Status 404 returned error can't find the container with id e730b9efe8028f63d83ae3f777bd475471b59e701591de4fd8a06651cae3e86a
Jul 21 13:04:45.360555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.360530    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07172f4-bee8-4908-9524-38c1c269d430" path="/var/lib/kubelet/pods/a07172f4-bee8-4908-9524-38c1c269d430/volumes"
Jul 21 13:04:45.549695 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:45.549599    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-k6bs8" event={"ID":"5c548be2-4f91-4c35-bce1-7782151ea23f","Type":"ContainerStarted","Data":"e730b9efe8028f63d83ae3f777bd475471b59e701591de4fd8a06651cae3e86a"}
Jul 21 13:04:46.556716 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:46.556687    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688696d74-k6bs8" event={"ID":"5c548be2-4f91-4c35-bce1-7782151ea23f","Type":"ContainerStarted","Data":"7f9d3fbf37a5ce1533c148630a3bec7f778a5f9bd62ca3172164d43153b19630"}
Jul 21 13:04:46.557180 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:46.556788    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:04:46.576111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:46.576064    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-688696d74-k6bs8" podStartSLOduration=2.238933672 podStartE2EDuration="2.576051768s" totalImagesPullingTime="337.118096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:04:46.574858692 +0000 UTC m=+831.611888769" watchObservedRunningTime="2026-07-21 13:04:46.576051768 +0000 UTC m=+831.613081845"
Jul 21 13:04:57.564697 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:04:57.564665    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688696d74-k6bs8"
Jul 21 13:05:55.354115 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:05:55.354090    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:05:55.355695 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:05:55.355669    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:09:40.526807 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:40.526774    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 13:09:40.527294 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:40.526977    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" podUID="4d1331bc-c0de-4a85-9c37-757eae31d11e" containerName="manager" containerID="cri-o://091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0" gracePeriod=10
Jul 21 13:09:44.075101 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.075080    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 13:09:44.161396 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.161361    2532 generic.go:356] "Generic (PLEG): container finished" podID="4d1331bc-c0de-4a85-9c37-757eae31d11e" containerID="091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0" exitCode=0
Jul 21 13:09:44.161555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.161411    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"
Jul 21 13:09:44.161555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.161454    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" event={"ID":"4d1331bc-c0de-4a85-9c37-757eae31d11e","Type":"ContainerDied","Data":"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"}
Jul 21 13:09:44.161555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.161514    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn" event={"ID":"4d1331bc-c0de-4a85-9c37-757eae31d11e","Type":"ContainerDied","Data":"798b1e231c51a23754f70d41667839aee302d930c584002656980acdff011284"}
Jul 21 13:09:44.161555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.161538    2532 scope.go:117] "RemoveContainer" containerID="091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"
Jul 21 13:09:44.173884 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.173864    2532 scope.go:117] "RemoveContainer" containerID="091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"
Jul 21 13:09:44.174264 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:09:44.174234    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0\": container with ID starting with 091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0 not found: ID does not exist" containerID="091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"
Jul 21 13:09:44.174359 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.174275    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0"} err="failed to get container status \"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0\": rpc error: code = NotFound desc = could not find container \"091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0\": container with ID starting with 091f5f3e0e9074cc73e3b3e68a7b77e252206a78e2e9241ae77d058528c9b0f0 not found: ID does not exist"
Jul 21 13:09:44.180890 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.180870    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume\") pod \"4d1331bc-c0de-4a85-9c37-757eae31d11e\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") "
Jul 21 13:09:44.180988 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.180976    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt6f8\" (UniqueName: \"kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8\") pod \"4d1331bc-c0de-4a85-9c37-757eae31d11e\" (UID: \"4d1331bc-c0de-4a85-9c37-757eae31d11e\") "
Jul 21 13:09:44.181320 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.181300    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d1331bc-c0de-4a85-9c37-757eae31d11e" (UID: "4d1331bc-c0de-4a85-9c37-757eae31d11e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:09:44.183002 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.182978    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8" (OuterVolumeSpecName: "kube-api-access-vt6f8") pod "4d1331bc-c0de-4a85-9c37-757eae31d11e" (UID: "4d1331bc-c0de-4a85-9c37-757eae31d11e"). InnerVolumeSpecName "kube-api-access-vt6f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:09:44.281924 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.281882    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt6f8\" (UniqueName: \"kubernetes.io/projected/4d1331bc-c0de-4a85-9c37-757eae31d11e-kube-api-access-vt6f8\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:09:44.281924 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.281919    2532 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d1331bc-c0de-4a85-9c37-757eae31d11e-extensions-socket-volume\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:09:44.486556 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.486521    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 13:09:44.490138 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:44.490114    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zdmbn"]
Jul 21 13:09:45.360627 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:09:45.360596    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d1331bc-c0de-4a85-9c37-757eae31d11e" path="/var/lib/kubelet/pods/4d1331bc-c0de-4a85-9c37-757eae31d11e/volumes"
Jul 21 13:10:41.911485 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.911449    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"]
Jul 21 13:10:41.911903 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.911800    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1331bc-c0de-4a85-9c37-757eae31d11e" containerName="manager"
Jul 21 13:10:41.911903 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.911811    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1331bc-c0de-4a85-9c37-757eae31d11e" containerName="manager"
Jul 21 13:10:41.911903 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.911879    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1331bc-c0de-4a85-9c37-757eae31d11e" containerName="manager"
Jul 21 13:10:41.915012 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.914992    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:41.918111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.918087    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-scmm2\""
Jul 21 13:10:41.927111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:41.927090    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"]
Jul 21 13:10:42.053503 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.053469    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a26039-ca0e-4fbd-84b9-19b7c579465e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.053674 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.053517    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqqj\" (UniqueName: \"kubernetes.io/projected/42a26039-ca0e-4fbd-84b9-19b7c579465e-kube-api-access-8jqqj\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.154601 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.154562    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqqj\" (UniqueName: \"kubernetes.io/projected/42a26039-ca0e-4fbd-84b9-19b7c579465e-kube-api-access-8jqqj\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.154765 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.154643    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a26039-ca0e-4fbd-84b9-19b7c579465e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.154992 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.154975    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42a26039-ca0e-4fbd-84b9-19b7c579465e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.166766 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.166698    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqqj\" (UniqueName: \"kubernetes.io/projected/42a26039-ca0e-4fbd-84b9-19b7c579465e-kube-api-access-8jqqj\") pod \"kuadrant-operator-controller-manager-86878c769f-mqfzv\" (UID: \"42a26039-ca0e-4fbd-84b9-19b7c579465e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.225760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.225718    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.373613 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:10:42.373585    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a26039_ca0e_4fbd_84b9_19b7c579465e.slice/crio-7cb819d5065534bbb4626a2773f350eb0bbfc096579d775fd6cd1589bd09ea5e WatchSource:0}: Error finding container 7cb819d5065534bbb4626a2773f350eb0bbfc096579d775fd6cd1589bd09ea5e: Status 404 returned error can't find the container with id 7cb819d5065534bbb4626a2773f350eb0bbfc096579d775fd6cd1589bd09ea5e
Jul 21 13:10:42.373799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.373777    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"]
Jul 21 13:10:42.460386 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.460352    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv" event={"ID":"42a26039-ca0e-4fbd-84b9-19b7c579465e","Type":"ContainerStarted","Data":"c9c9f9c4acfb727ed0f78b98afa6629a52a0bf99b1a5b044537664de13fd4db8"}
Jul 21 13:10:42.460509 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.460407    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv" event={"ID":"42a26039-ca0e-4fbd-84b9-19b7c579465e","Type":"ContainerStarted","Data":"7cb819d5065534bbb4626a2773f350eb0bbfc096579d775fd6cd1589bd09ea5e"}
Jul 21 13:10:42.460509 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.460472    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:42.483931 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:42.483886    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv" podStartSLOduration=1.483870655 podStartE2EDuration="1.483870655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:10:42.481334419 +0000 UTC m=+1187.518364494" watchObservedRunningTime="2026-07-21 13:10:42.483870655 +0000 UTC m=+1187.520900802"
Jul 21 13:10:53.468672 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:53.468636    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mqfzv"
Jul 21 13:10:55.388417 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:55.388392    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:10:55.390903 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:10:55.390885    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:15:00.180062 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.180023    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"]
Jul 21 13:15:00.184028 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.184004    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"
Jul 21 13:15:00.187896 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.187878    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:15:00.193604 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.193584    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"
Jul 21 13:15:00.206550 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.206525    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"]
Jul 21 13:15:00.364339 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.364303    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"]
Jul 21 13:15:00.365600 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:15:00.365567    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc51f7b5_8be3_43a1_8c85_033c5e6f1094.slice/crio-92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d WatchSource:0}: Error finding container 92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d: Status 404 returned error can't find the container with id 92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d
Jul 21 13:15:00.879507 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.879414    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk" event={"ID":"bc51f7b5-8be3-43a1-8c85-033c5e6f1094","Type":"ContainerStarted","Data":"074c2302ea866b5cca63b2ecc00391e20de5c5c40046c4493cd9e9950e8fd704"}
Jul 21 13:15:00.879507 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.879475    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk" event={"ID":"bc51f7b5-8be3-43a1-8c85-033c5e6f1094","Type":"ContainerStarted","Data":"92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d"}
Jul 21 13:15:00.901398 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:00.901349    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk" podStartSLOduration=0.901331801 podStartE2EDuration="901.331801ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:15:00.89977395 +0000 UTC m=+1445.936804024" watchObservedRunningTime="2026-07-21 13:15:00.901331801 +0000 UTC m=+1445.938361925"
Jul 21 13:15:01.886513 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:01.886476    2532 generic.go:356] "Generic (PLEG): container finished" podID="bc51f7b5-8be3-43a1-8c85-033c5e6f1094" containerID="074c2302ea866b5cca63b2ecc00391e20de5c5c40046c4493cd9e9950e8fd704" exitCode=0
Jul 21 13:15:01.886969 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:01.886564    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk" event={"ID":"bc51f7b5-8be3-43a1-8c85-033c5e6f1094","Type":"ContainerDied","Data":"074c2302ea866b5cca63b2ecc00391e20de5c5c40046c4493cd9e9950e8fd704"}
Jul 21 13:15:03.029881 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:03.029860    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"
Jul 21 13:15:03.900386 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:03.900359    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk"
Jul 21 13:15:03.900561 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:03.900393    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743995-g6rwk" event={"ID":"bc51f7b5-8be3-43a1-8c85-033c5e6f1094","Type":"ContainerDied","Data":"92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d"}
Jul 21 13:15:03.900561 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:03.900443    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92168a81fd12310688179791927edf5344cacf0b4f540a1d677838c28ff6a63d"
Jul 21 13:15:55.420754 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:55.420724    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:15:55.425638 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:15:55.425613    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:17:47.535730 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.535657    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:17:47.536229 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.536038    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc51f7b5-8be3-43a1-8c85-033c5e6f1094" containerName="cleanup"
Jul 21 13:17:47.536229 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.536049    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc51f7b5-8be3-43a1-8c85-033c5e6f1094" containerName="cleanup"
Jul 21 13:17:47.536229 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.536122    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc51f7b5-8be3-43a1-8c85-033c5e6f1094" containerName="cleanup"
Jul 21 13:17:47.539533 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.539515    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.542667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.542648    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-209ca517-serving-cert\""
Jul 21 13:17:47.552125 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.552103    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:17:47.699608 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.699567    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.699791 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.699653    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnhh\" (UniqueName: \"kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.699791 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.699678    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.801201 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.801096    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.801201 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.801182    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnhh\" (UniqueName: \"kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.801389 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.801219    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.801764 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.801746    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.803865 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.803844    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.811569 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.811540    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnhh\" (UniqueName: \"kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh\") pod \"maas-api-e2e-ait-209ca517-758b9fbff4-nk495\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:47.850416 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:47.850388    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:48.012966 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.012941    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:17:48.015434 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:17:48.015388    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca78212_b940_46b3_8c6d_8aaa5796172d.slice/crio-86a07fcc820d8eb19510faf69d3855b315ea997add4d131c9ff7afc32891412b WatchSource:0}: Error finding container 86a07fcc820d8eb19510faf69d3855b315ea997add4d131c9ff7afc32891412b: Status 404 returned error can't find the container with id 86a07fcc820d8eb19510faf69d3855b315ea997add4d131c9ff7afc32891412b
Jul 21 13:17:48.017014 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.016998    2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 13:17:48.820806 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.820774    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" event={"ID":"4ca78212-b940-46b3-8c6d-8aaa5796172d","Type":"ContainerStarted","Data":"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"}
Jul 21 13:17:48.821262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.820829    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" event={"ID":"4ca78212-b940-46b3-8c6d-8aaa5796172d","Type":"ContainerStarted","Data":"86a07fcc820d8eb19510faf69d3855b315ea997add4d131c9ff7afc32891412b"}
Jul 21 13:17:48.821262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.820919    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:17:48.844190 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:48.844130    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" podStartSLOduration=1.258913546 podStartE2EDuration="1.844116641s" totalImagesPullingTime="585.203095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:17:48.842037319 +0000 UTC m=+1613.879067394" watchObservedRunningTime="2026-07-21 13:17:48.844116641 +0000 UTC m=+1613.881146715"
Jul 21 13:17:54.832294 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:17:54.832262    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:18:12.874626 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:12.874592    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"]
Jul 21 13:18:12.878377 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:12.878355    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:12.881741 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:12.881716    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:18:12.887304 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:12.887278    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"]
Jul 21 13:18:12.922574 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:12.922548    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-209ca517-7wf5v\" (UID: \"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:13.023827 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.023793    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-209ca517-7wf5v\" (UID: \"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:13.024431 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.024411    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-209ca517-7wf5v\" (UID: \"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:13.191267 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.191202    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:13.336971 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.336947    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"]
Jul 21 13:18:13.338933 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:18:13.338908    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c37dfd_a587_4ecd_a4d1_3f0fe3e1bae1.slice/crio-36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1 WatchSource:0}: Error finding container 36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1: Status 404 returned error can't find the container with id 36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1
Jul 21 13:18:13.958637 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.958601    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v" event={"ID":"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1","Type":"ContainerStarted","Data":"11bcf65bf0d370493c053cc2a038096320d9004358c76947d902b1376b85ab2a"}
Jul 21 13:18:13.959034 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.958663    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v" event={"ID":"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1","Type":"ContainerStarted","Data":"36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1"}
Jul 21 13:18:13.985829 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:13.985781    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v" podStartSLOduration=1.985765091 podStartE2EDuration="1.985765091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:18:13.982877786 +0000 UTC m=+1639.019907860" watchObservedRunningTime="2026-07-21 13:18:13.985765091 +0000 UTC m=+1639.022795165"
Jul 21 13:18:14.965472 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:14.965438    2532 generic.go:356] "Generic (PLEG): container finished" podID="59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" containerID="11bcf65bf0d370493c053cc2a038096320d9004358c76947d902b1376b85ab2a" exitCode=0
Jul 21 13:18:14.965851 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:14.965520    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v" event={"ID":"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1","Type":"ContainerDied","Data":"11bcf65bf0d370493c053cc2a038096320d9004358c76947d902b1376b85ab2a"}
Jul 21 13:18:16.105243 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.105217    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:16.253842 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.253766    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca\") pod \"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1\" (UID: \"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1\") "
Jul 21 13:18:16.254098 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.254076    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" (UID: "59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:18:16.354969 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.354947    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:18:16.976810 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.976783    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"
Jul 21 13:18:16.976810 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.976786    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v" event={"ID":"59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1","Type":"ContainerDied","Data":"36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1"}
Jul 21 13:18:16.977069 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:16.976836    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36cceb04cfd10436e058ac1f6ae3ee948d3326016d2a6ee1e6fbbd7befd40ab1"
Jul 21 13:18:23.322018 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.321980    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:18:23.322548 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.322244    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" podUID="4ca78212-b940-46b3-8c6d-8aaa5796172d" containerName="maas-api" containerID="cri-o://b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4" gracePeriod=30
Jul 21 13:18:23.575715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.575656    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:18:23.722104 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.722076    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca\") pod \"4ca78212-b940-46b3-8c6d-8aaa5796172d\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") "
Jul 21 13:18:23.722319 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.722116    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls\") pod \"4ca78212-b940-46b3-8c6d-8aaa5796172d\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") "
Jul 21 13:18:23.722319 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.722188    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnnhh\" (UniqueName: \"kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh\") pod \"4ca78212-b940-46b3-8c6d-8aaa5796172d\" (UID: \"4ca78212-b940-46b3-8c6d-8aaa5796172d\") "
Jul 21 13:18:23.722513 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.722487    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ca78212-b940-46b3-8c6d-8aaa5796172d" (UID: "4ca78212-b940-46b3-8c6d-8aaa5796172d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:18:23.724401 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.724376    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh" (OuterVolumeSpecName: "kube-api-access-jnnhh") pod "4ca78212-b940-46b3-8c6d-8aaa5796172d" (UID: "4ca78212-b940-46b3-8c6d-8aaa5796172d"). InnerVolumeSpecName "kube-api-access-jnnhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:18:23.724401 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.724389    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ca78212-b940-46b3-8c6d-8aaa5796172d" (UID: "4ca78212-b940-46b3-8c6d-8aaa5796172d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:18:23.823704 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.823680    2532 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca78212-b940-46b3-8c6d-8aaa5796172d-openshift-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:18:23.823704 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.823701    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ca78212-b940-46b3-8c6d-8aaa5796172d-maas-api-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:18:23.823843 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:23.823714    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnnhh\" (UniqueName: \"kubernetes.io/projected/4ca78212-b940-46b3-8c6d-8aaa5796172d-kube-api-access-jnnhh\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:18:24.015647 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.015612    2532 generic.go:356] "Generic (PLEG): container finished" podID="4ca78212-b940-46b3-8c6d-8aaa5796172d" containerID="b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4" exitCode=0
Jul 21 13:18:24.015853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.015655    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"
Jul 21 13:18:24.015853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.015695    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" event={"ID":"4ca78212-b940-46b3-8c6d-8aaa5796172d","Type":"ContainerDied","Data":"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"}
Jul 21 13:18:24.015853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.015752    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495" event={"ID":"4ca78212-b940-46b3-8c6d-8aaa5796172d","Type":"ContainerDied","Data":"86a07fcc820d8eb19510faf69d3855b315ea997add4d131c9ff7afc32891412b"}
Jul 21 13:18:24.015853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.015779    2532 scope.go:117] "RemoveContainer" containerID="b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"
Jul 21 13:18:24.025847 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.025828    2532 scope.go:117] "RemoveContainer" containerID="b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"
Jul 21 13:18:24.026097 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:18:24.026079    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4\": container with ID starting with b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4 not found: ID does not exist" containerID="b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"
Jul 21 13:18:24.026184 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.026106    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4"} err="failed to get container status \"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4\": rpc error: code = NotFound desc = could not find container \"b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4\": container with ID starting with b5a18a1d1bdce9de0edb37349d97c324c3ce3e469accb6e22de1ddf342cafab4 not found: ID does not exist"
Jul 21 13:18:24.040405 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.040386    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:18:24.045271 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:24.045252    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-209ca517-758b9fbff4-nk495"]
Jul 21 13:18:25.357755 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:25.357724    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca78212-b940-46b3-8c6d-8aaa5796172d" path="/var/lib/kubelet/pods/4ca78212-b940-46b3-8c6d-8aaa5796172d/volumes"
Jul 21 13:18:27.979057 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:27.979023    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"]
Jul 21 13:18:27.989250 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:27.984011    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-209ca517-7wf5v"]
Jul 21 13:18:29.358622 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:29.358591    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" path="/var/lib/kubelet/pods/59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1/volumes"
Jul 21 13:18:31.728406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728379    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:18:31.728763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728746    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" containerName="revoke-keys"
Jul 21 13:18:31.728763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728757    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" containerName="revoke-keys"
Jul 21 13:18:31.728833 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728767    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca78212-b940-46b3-8c6d-8aaa5796172d" containerName="maas-api"
Jul 21 13:18:31.728833 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728773    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca78212-b940-46b3-8c6d-8aaa5796172d" containerName="maas-api"
Jul 21 13:18:31.728833 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728832    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c37dfd-a587-4ecd-a4d1-3f0fe3e1bae1" containerName="revoke-keys"
Jul 21 13:18:31.728924 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.728842    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca78212-b940-46b3-8c6d-8aaa5796172d" containerName="maas-api"
Jul 21 13:18:31.732012 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.731995    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.735509 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.735490    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8bfb8415-serving-cert\""
Jul 21 13:18:31.750631 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.750609    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:18:31.888170 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.888136    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.888317 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.888203    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.888317 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.888234    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhjw\" (UniqueName: \"kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.989477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.989415    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.989477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.989449    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.989477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.989468    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhjw\" (UniqueName: \"kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.990083 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.990062    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:31.991938 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:31.991920    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:32.001251 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:32.001232    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhjw\" (UniqueName: \"kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw\") pod \"maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:32.041893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:32.041868    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:32.197426 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:32.197399    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:18:32.198941 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:18:32.198905    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2d7801_34b5_4e6e_91cc_ea2eaa460025.slice/crio-8cc2597489211bb0b6742da386596da0fa3a9cddd55e42a0be29e8208df79b17 WatchSource:0}: Error finding container 8cc2597489211bb0b6742da386596da0fa3a9cddd55e42a0be29e8208df79b17: Status 404 returned error can't find the container with id 8cc2597489211bb0b6742da386596da0fa3a9cddd55e42a0be29e8208df79b17
Jul 21 13:18:33.070855 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:33.070816    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" event={"ID":"5f2d7801-34b5-4e6e-91cc-ea2eaa460025","Type":"ContainerStarted","Data":"8cc2597489211bb0b6742da386596da0fa3a9cddd55e42a0be29e8208df79b17"}
Jul 21 13:18:35.084724 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:35.084686    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" event={"ID":"5f2d7801-34b5-4e6e-91cc-ea2eaa460025","Type":"ContainerStarted","Data":"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"}
Jul 21 13:18:35.085122 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:35.084815    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:35.105951 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:35.105901    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" podStartSLOduration=2.18440942 podStartE2EDuration="4.105886936s" totalImagesPullingTime="1.921477516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:18:35.103611701 +0000 UTC m=+1660.140641774" watchObservedRunningTime="2026-07-21 13:18:35.105886936 +0000 UTC m=+1660.142917010"
Jul 21 13:18:41.095559 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:41.095532    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:18:56.647217 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.647179    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"]
Jul 21 13:18:56.650597 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.650581    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:56.653868 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.653841    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:18:56.657059 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.657035    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"]
Jul 21 13:18:56.690356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.690316    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt\" (UID: \"516684e3-c183-49d3-8022-9e3e51163005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:56.791006 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.790966    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt\" (UID: \"516684e3-c183-49d3-8022-9e3e51163005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:56.791719 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.791697    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt\" (UID: \"516684e3-c183-49d3-8022-9e3e51163005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:56.962574 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:56.962541    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:57.103244 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:57.103215    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"]
Jul 21 13:18:57.105202 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:18:57.105168    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516684e3_c183_49d3_8022_9e3e51163005.slice/crio-2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5 WatchSource:0}: Error finding container 2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5: Status 404 returned error can't find the container with id 2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5
Jul 21 13:18:57.209910 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:57.209878    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt" event={"ID":"516684e3-c183-49d3-8022-9e3e51163005","Type":"ContainerStarted","Data":"2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5"}
Jul 21 13:18:58.216759 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:58.216720    2532 generic.go:356] "Generic (PLEG): container finished" podID="516684e3-c183-49d3-8022-9e3e51163005" containerID="39d9139941bde01adb00b6c0f27245871ecf91e98f3514f1249d26685e226c40" exitCode=0
Jul 21 13:18:58.217183 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:58.216767    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt" event={"ID":"516684e3-c183-49d3-8022-9e3e51163005","Type":"ContainerDied","Data":"39d9139941bde01adb00b6c0f27245871ecf91e98f3514f1249d26685e226c40"}
Jul 21 13:18:59.359986 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:59.359958    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:18:59.406788 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:59.406757    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca\") pod \"516684e3-c183-49d3-8022-9e3e51163005\" (UID: \"516684e3-c183-49d3-8022-9e3e51163005\") "
Jul 21 13:18:59.407097 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:59.407077    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "516684e3-c183-49d3-8022-9e3e51163005" (UID: "516684e3-c183-49d3-8022-9e3e51163005"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:18:59.507326 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:18:59.507240    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/516684e3-c183-49d3-8022-9e3e51163005-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:00.228587 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:00.228563    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"
Jul 21 13:19:00.228797 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:00.228629    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt" event={"ID":"516684e3-c183-49d3-8022-9e3e51163005","Type":"ContainerDied","Data":"2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5"}
Jul 21 13:19:00.228797 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:00.228699    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d987c4f3b2a6d8322738560296d33ec84859481008a73d0bceb6b620263a1d5"
Jul 21 13:19:07.227244 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.227207    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:19:07.227695 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.227403    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" podUID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" containerName="maas-api" containerID="cri-o://2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92" gracePeriod=30
Jul 21 13:19:07.468093 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.468068    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:19:07.575425 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.575356    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca\") pod \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") "
Jul 21 13:19:07.575425 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.575418    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls\") pod \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") "
Jul 21 13:19:07.575625 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.575438    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfhjw\" (UniqueName: \"kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw\") pod \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\" (UID: \"5f2d7801-34b5-4e6e-91cc-ea2eaa460025\") "
Jul 21 13:19:07.575697 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.575672    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f2d7801-34b5-4e6e-91cc-ea2eaa460025" (UID: "5f2d7801-34b5-4e6e-91cc-ea2eaa460025"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:19:07.577595 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.577570    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw" (OuterVolumeSpecName: "kube-api-access-cfhjw") pod "5f2d7801-34b5-4e6e-91cc-ea2eaa460025" (UID: "5f2d7801-34b5-4e6e-91cc-ea2eaa460025"). InnerVolumeSpecName "kube-api-access-cfhjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:19:07.577760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.577739    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f2d7801-34b5-4e6e-91cc-ea2eaa460025" (UID: "5f2d7801-34b5-4e6e-91cc-ea2eaa460025"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:19:07.676345 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.676321    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-maas-api-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:07.676345 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.676341    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfhjw\" (UniqueName: \"kubernetes.io/projected/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-kube-api-access-cfhjw\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:07.676345 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:07.676352    2532 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2d7801-34b5-4e6e-91cc-ea2eaa460025-openshift-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:08.275819 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.275782    2532 generic.go:356] "Generic (PLEG): container finished" podID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" containerID="2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92" exitCode=0
Jul 21 13:19:08.275819 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.275825    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" event={"ID":"5f2d7801-34b5-4e6e-91cc-ea2eaa460025","Type":"ContainerDied","Data":"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"}
Jul 21 13:19:08.276321 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.275836    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"
Jul 21 13:19:08.276321 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.275876    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq" event={"ID":"5f2d7801-34b5-4e6e-91cc-ea2eaa460025","Type":"ContainerDied","Data":"8cc2597489211bb0b6742da386596da0fa3a9cddd55e42a0be29e8208df79b17"}
Jul 21 13:19:08.276321 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.275899    2532 scope.go:117] "RemoveContainer" containerID="2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"
Jul 21 13:19:08.286193 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.285909    2532 scope.go:117] "RemoveContainer" containerID="2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"
Jul 21 13:19:08.286380 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:19:08.286356    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92\": container with ID starting with 2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92 not found: ID does not exist" containerID="2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"
Jul 21 13:19:08.286500 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.286395    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92"} err="failed to get container status \"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92\": rpc error: code = NotFound desc = could not find container \"2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92\": container with ID starting with 2f48a5bb3bdd7be80e1e34759a009ac43fee7a6f7ec4eb659263bfd84a5d7f92 not found: ID does not exist"
Jul 21 13:19:08.306900 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.306874    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:19:08.314368 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:08.314347    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8bfb8415-74b6b95c57-mmqnq"]
Jul 21 13:19:09.358670 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:09.358638    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" path="/var/lib/kubelet/pods/5f2d7801-34b5-4e6e-91cc-ea2eaa460025/volumes"
Jul 21 13:19:11.747130 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:11.747091    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"]
Jul 21 13:19:11.750336 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:11.750306    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8bfb8415-vrtzt"]
Jul 21 13:19:13.358333 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:13.358303    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516684e3-c183-49d3-8022-9e3e51163005" path="/var/lib/kubelet/pods/516684e3-c183-49d3-8022-9e3e51163005/volumes"
Jul 21 13:19:15.692299 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692270    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:15.692691 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692640    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516684e3-c183-49d3-8022-9e3e51163005" containerName="revoke-keys"
Jul 21 13:19:15.692691 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692651    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="516684e3-c183-49d3-8022-9e3e51163005" containerName="revoke-keys"
Jul 21 13:19:15.692691 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692662    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" containerName="maas-api"
Jul 21 13:19:15.692691 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692668    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" containerName="maas-api"
Jul 21 13:19:15.692848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692733    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2d7801-34b5-4e6e-91cc-ea2eaa460025" containerName="maas-api"
Jul 21 13:19:15.692848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.692739    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="516684e3-c183-49d3-8022-9e3e51163005" containerName="revoke-keys"
Jul 21 13:19:15.697318 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.697298    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.706859 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.706834    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a6824535-serving-cert\""
Jul 21 13:19:15.722452 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.722429    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:15.743651 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.743623    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.743781 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.743672    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjkh\" (UniqueName: \"kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.743820 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.743780    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.844855 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.844824    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.845028 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.844875    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjkh\" (UniqueName: \"kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.845028 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.844958    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.845143 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:19:15.845081    2532 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-serving-cert: secret "maas-api-e2e-ait-a6824535-serving-cert" not found
Jul 21 13:19:15.845260 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:19:15.845146    2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls podName:c3a95064-fbb0-4360-a366-31959c19703b nodeName:}" failed. No retries permitted until 2026-07-21 13:19:16.345125061 +0000 UTC m=+1701.382155126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls") pod "maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" (UID: "c3a95064-fbb0-4360-a366-31959c19703b") : secret "maas-api-e2e-ait-a6824535-serving-cert" not found
Jul 21 13:19:15.845498 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.845480    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:15.856523 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:15.856494    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjkh\" (UniqueName: \"kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:16.350454 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:16.350366    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:16.353021 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:16.352990    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") pod \"maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:16.608241 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:16.608123    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:16.763541 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:16.763514    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:16.765634 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:19:16.765607    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a95064_fbb0_4360_a366_31959c19703b.slice/crio-ebc9a43c95bf3c3f4d4a65bc579f4bb8ac77ffa4628d43b252fcca5831e58268 WatchSource:0}: Error finding container ebc9a43c95bf3c3f4d4a65bc579f4bb8ac77ffa4628d43b252fcca5831e58268: Status 404 returned error can't find the container with id ebc9a43c95bf3c3f4d4a65bc579f4bb8ac77ffa4628d43b252fcca5831e58268
Jul 21 13:19:17.333226 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:17.333192    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" event={"ID":"c3a95064-fbb0-4360-a366-31959c19703b","Type":"ContainerStarted","Data":"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"}
Jul 21 13:19:17.333384 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:17.333262    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" event={"ID":"c3a95064-fbb0-4360-a366-31959c19703b","Type":"ContainerStarted","Data":"ebc9a43c95bf3c3f4d4a65bc579f4bb8ac77ffa4628d43b252fcca5831e58268"}
Jul 21 13:19:17.333384 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:17.333348    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:17.354718 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:17.354668    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" podStartSLOduration=1.958945312 podStartE2EDuration="2.35465261s" totalImagesPullingTime="395.707298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:19:17.354218273 +0000 UTC m=+1702.391248343" watchObservedRunningTime="2026-07-21 13:19:17.35465261 +0000 UTC m=+1702.391682685"
Jul 21 13:19:23.344906 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:23.344880    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:41.660859 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.660827    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"]
Jul 21 13:19:41.664463 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.664444    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:41.667505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.667484    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:19:41.673301 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.672804    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"]
Jul 21 13:19:41.767718 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.767670    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a6824535-wvkdm\" (UID: \"719a98ed-ad2f-4c4f-8456-c48d95c81dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:41.869069 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.869034    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a6824535-wvkdm\" (UID: \"719a98ed-ad2f-4c4f-8456-c48d95c81dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:41.869740 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.869714    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a6824535-wvkdm\" (UID: \"719a98ed-ad2f-4c4f-8456-c48d95c81dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:41.977893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:41.977857    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:42.114208 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:42.114179    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"]
Jul 21 13:19:42.115745 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:19:42.115722    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719a98ed_ad2f_4c4f_8456_c48d95c81dd3.slice/crio-91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415 WatchSource:0}: Error finding container 91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415: Status 404 returned error can't find the container with id 91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415
Jul 21 13:19:42.469740 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:42.469708    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm" event={"ID":"719a98ed-ad2f-4c4f-8456-c48d95c81dd3","Type":"ContainerStarted","Data":"de2afd28478c5e0d8ec854654d3ed0f29d794bcab80a376fdf43121981e1154e"}
Jul 21 13:19:42.469907 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:42.469761    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm" event={"ID":"719a98ed-ad2f-4c4f-8456-c48d95c81dd3","Type":"ContainerStarted","Data":"91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415"}
Jul 21 13:19:42.487893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:42.487841    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm" podStartSLOduration=1.487826385 podStartE2EDuration="1.487826385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:19:42.486810005 +0000 UTC m=+1727.523840080" watchObservedRunningTime="2026-07-21 13:19:42.487826385 +0000 UTC m=+1727.524856458"
Jul 21 13:19:43.476643 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:43.476612    2532 generic.go:356] "Generic (PLEG): container finished" podID="719a98ed-ad2f-4c4f-8456-c48d95c81dd3" containerID="de2afd28478c5e0d8ec854654d3ed0f29d794bcab80a376fdf43121981e1154e" exitCode=0
Jul 21 13:19:43.477038 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:43.476698    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm" event={"ID":"719a98ed-ad2f-4c4f-8456-c48d95c81dd3","Type":"ContainerDied","Data":"de2afd28478c5e0d8ec854654d3ed0f29d794bcab80a376fdf43121981e1154e"}
Jul 21 13:19:44.617968 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:44.617946    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:44.793354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:44.793267    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca\") pod \"719a98ed-ad2f-4c4f-8456-c48d95c81dd3\" (UID: \"719a98ed-ad2f-4c4f-8456-c48d95c81dd3\") "
Jul 21 13:19:44.793716 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:44.793690    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "719a98ed-ad2f-4c4f-8456-c48d95c81dd3" (UID: "719a98ed-ad2f-4c4f-8456-c48d95c81dd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:19:44.894715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:44.894662    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719a98ed-ad2f-4c4f-8456-c48d95c81dd3-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:45.489882 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:45.489854    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"
Jul 21 13:19:45.489882 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:45.489856    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm" event={"ID":"719a98ed-ad2f-4c4f-8456-c48d95c81dd3","Type":"ContainerDied","Data":"91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415"}
Jul 21 13:19:45.490081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:45.489907    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91f3f216146378f18a3285f85d2560aba15fc208cd858d931863c3aa494a6415"
Jul 21 13:19:52.213979 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.213948    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:52.214473 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.214262    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" podUID="c3a95064-fbb0-4360-a366-31959c19703b" containerName="maas-api" containerID="cri-o://16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664" gracePeriod=30
Jul 21 13:19:52.471970 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.471906    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:52.530131 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.530100    2532 generic.go:356] "Generic (PLEG): container finished" podID="c3a95064-fbb0-4360-a366-31959c19703b" containerID="16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664" exitCode=0
Jul 21 13:19:52.530313 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.530148    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"
Jul 21 13:19:52.530313 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.530186    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" event={"ID":"c3a95064-fbb0-4360-a366-31959c19703b","Type":"ContainerDied","Data":"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"}
Jul 21 13:19:52.530313 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.530240    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j" event={"ID":"c3a95064-fbb0-4360-a366-31959c19703b","Type":"ContainerDied","Data":"ebc9a43c95bf3c3f4d4a65bc579f4bb8ac77ffa4628d43b252fcca5831e58268"}
Jul 21 13:19:52.530313 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.530265    2532 scope.go:117] "RemoveContainer" containerID="16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"
Jul 21 13:19:52.539445 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.539427    2532 scope.go:117] "RemoveContainer" containerID="16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"
Jul 21 13:19:52.539708 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:19:52.539682    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664\": container with ID starting with 16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664 not found: ID does not exist" containerID="16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"
Jul 21 13:19:52.539776 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.539722    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664"} err="failed to get container status \"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664\": rpc error: code = NotFound desc = could not find container \"16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664\": container with ID starting with 16f6709fd430eecd8325502501b98ef2994ccca1a0534a0076f81126534c4664 not found: ID does not exist"
Jul 21 13:19:52.661977 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.661953    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca\") pod \"c3a95064-fbb0-4360-a366-31959c19703b\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") "
Jul 21 13:19:52.662111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.662013    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfjkh\" (UniqueName: \"kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh\") pod \"c3a95064-fbb0-4360-a366-31959c19703b\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") "
Jul 21 13:19:52.662111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.662038    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") pod \"c3a95064-fbb0-4360-a366-31959c19703b\" (UID: \"c3a95064-fbb0-4360-a366-31959c19703b\") "
Jul 21 13:19:52.662397 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.662372    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3a95064-fbb0-4360-a366-31959c19703b" (UID: "c3a95064-fbb0-4360-a366-31959c19703b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:19:52.664364 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.664316    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh" (OuterVolumeSpecName: "kube-api-access-rfjkh") pod "c3a95064-fbb0-4360-a366-31959c19703b" (UID: "c3a95064-fbb0-4360-a366-31959c19703b"). InnerVolumeSpecName "kube-api-access-rfjkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:19:52.664472 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.664452    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3a95064-fbb0-4360-a366-31959c19703b" (UID: "c3a95064-fbb0-4360-a366-31959c19703b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:19:52.763268 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.763178    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfjkh\" (UniqueName: \"kubernetes.io/projected/c3a95064-fbb0-4360-a366-31959c19703b-kube-api-access-rfjkh\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:52.763268 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.763205    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a95064-fbb0-4360-a366-31959c19703b-maas-api-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:52.763268 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.763215    2532 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3a95064-fbb0-4360-a366-31959c19703b-openshift-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:19:52.867116 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.867081    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:52.873077 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:52.873048    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6824535-bc75c5fb8-ml49j"]
Jul 21 13:19:53.359601 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:53.359571    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a95064-fbb0-4360-a366-31959c19703b" path="/var/lib/kubelet/pods/c3a95064-fbb0-4360-a366-31959c19703b/volumes"
Jul 21 13:19:56.773311 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:56.773272    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"]
Jul 21 13:19:56.778216 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:56.778190    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a6824535-wvkdm"]
Jul 21 13:19:57.358230 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:57.358197    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719a98ed-ad2f-4c4f-8456-c48d95c81dd3" path="/var/lib/kubelet/pods/719a98ed-ad2f-4c4f-8456-c48d95c81dd3/volumes"
Jul 21 13:19:59.188369 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188335    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:19:59.188750 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188736    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719a98ed-ad2f-4c4f-8456-c48d95c81dd3" containerName="revoke-keys"
Jul 21 13:19:59.188804 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188752    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="719a98ed-ad2f-4c4f-8456-c48d95c81dd3" containerName="revoke-keys"
Jul 21 13:19:59.188804 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188762    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a95064-fbb0-4360-a366-31959c19703b" containerName="maas-api"
Jul 21 13:19:59.188804 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188767    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a95064-fbb0-4360-a366-31959c19703b" containerName="maas-api"
Jul 21 13:19:59.188901 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188828    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a95064-fbb0-4360-a366-31959c19703b" containerName="maas-api"
Jul 21 13:19:59.188901 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.188841    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="719a98ed-ad2f-4c4f-8456-c48d95c81dd3" containerName="revoke-keys"
Jul 21 13:19:59.192044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.192028    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.199598 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.199567    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 13:19:59.199739 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.199614    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-222aaf00-openshift-default-dockercfg-2j7jv\""
Jul 21 13:19:59.213177 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213139    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213183    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213214    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213236    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213259    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdsb\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213287 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213278    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213343    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213383    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.213505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.213403    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.221586 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.221554    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:19:59.313795 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.313758    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.313795 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.313801    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.313830    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.313978    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314033    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdsb\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314069    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314340 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314144    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314340 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314236    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314340 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314272    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314485 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314337    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314485 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314468    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314757 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314553    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314757 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314565    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.314863 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.314832    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.316319 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.316293    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.316591 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.316572    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.325638 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.325609    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.325783 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.325767    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdsb\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb\") pod \"e2e-derive-222aaf00-openshift-default-675df58559-px4pz\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") " pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.502780 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.502746    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:19:59.671531 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:19:59.671506    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:19:59.673833 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:19:59.673804    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81baa52_4fdc_40c6_b2e2_5d9d44bfa2c1.slice/crio-ef695f0644e674d77f5f90a509d9b86286b7143e1ee4c6e30ba69047a7eaa73c WatchSource:0}: Error finding container ef695f0644e674d77f5f90a509d9b86286b7143e1ee4c6e30ba69047a7eaa73c: Status 404 returned error can't find the container with id ef695f0644e674d77f5f90a509d9b86286b7143e1ee4c6e30ba69047a7eaa73c
Jul 21 13:20:00.581373 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:00.581331    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerStarted","Data":"ef695f0644e674d77f5f90a509d9b86286b7143e1ee4c6e30ba69047a7eaa73c"}
Jul 21 13:20:03.037111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:03.037068    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:03.037511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:03.037182    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:03.037511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:03.037231    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:03.602544 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:03.602510    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerStarted","Data":"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"}
Jul 21 13:20:03.632393 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:03.632344    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podStartSLOduration=1.271318118 podStartE2EDuration="4.632327741s" totalImagesPullingTime="3.361009623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:20:03.629671748 +0000 UTC m=+1748.666701832" watchObservedRunningTime="2026-07-21 13:20:03.632327741 +0000 UTC m=+1748.669357815"
Jul 21 13:20:04.503079 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:04.503042    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:04.508122 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:04.508096    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:04.614851 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:04.611023    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:04.614851 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:04.612230    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:05.181772 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.181742    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:05.185519 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.185499    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.189237 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.189216    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-222aaf00-serving-cert\""
Jul 21 13:20:05.202513 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.202485    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:05.265032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.264997    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rbz\" (UniqueName: \"kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.265211 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.265040    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.265211 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.265072    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.366493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.366461    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rbz\" (UniqueName: \"kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.366654 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.366503    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.366654 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.366533    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.367286 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.367264    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.369298 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.369272    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.383583 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.383557    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rbz\" (UniqueName: \"kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz\") pod \"maas-api-e2e-derive-222aaf00-58bf8c4889-5h578\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.495719 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.495687    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:05.647587 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:05.647557    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:05.648662 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:20:05.648639    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df9d019_1445_46f9_aff0_ea51fd007c1a.slice/crio-a370c955c88acf1c27ab3181d2daedcb2ea29e55a05e017d6b5ab3c350a7db2e WatchSource:0}: Error finding container a370c955c88acf1c27ab3181d2daedcb2ea29e55a05e017d6b5ab3c350a7db2e: Status 404 returned error can't find the container with id a370c955c88acf1c27ab3181d2daedcb2ea29e55a05e017d6b5ab3c350a7db2e
Jul 21 13:20:06.630999 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:06.630891    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" event={"ID":"8df9d019-1445-46f9-aff0-ea51fd007c1a","Type":"ContainerStarted","Data":"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"}
Jul 21 13:20:06.630999 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:06.630957    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" event={"ID":"8df9d019-1445-46f9-aff0-ea51fd007c1a","Type":"ContainerStarted","Data":"a370c955c88acf1c27ab3181d2daedcb2ea29e55a05e017d6b5ab3c350a7db2e"}
Jul 21 13:20:06.631262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:06.631205    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:12.642911 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:12.642882    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:12.672337 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:12.672275    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" podStartSLOduration=6.947754864 podStartE2EDuration="7.672254092s" totalImagesPullingTime="724.499228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:20:06.674301514 +0000 UTC m=+1751.711331589" watchObservedRunningTime="2026-07-21 13:20:12.672254092 +0000 UTC m=+1757.709284166"
Jul 21 13:20:16.698111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.698080    2532 generic.go:356] "Generic (PLEG): container finished" podID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerID="7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7" exitCode=0
Jul 21 13:20:16.698527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.698136    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerDied","Data":"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"}
Jul 21 13:20:16.698572 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.698545    2532 scope.go:117] "RemoveContainer" containerID="7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"
Jul 21 13:20:16.700594 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.700553    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:16.700699 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.700626    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:16.700699 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:16.700659    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:20:17.705436 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:17.705403    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerStarted","Data":"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"}
Jul 21 13:20:18.503111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:18.503072    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:18.504493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:18.504470    2532 patch_prober.go:28] interesting pod/e2e-derive-222aaf00-openshift-default-675df58559-px4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 13:20:18.504622 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:18.504540    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 13:20:19.503557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:19.503522    2532 patch_prober.go:28] interesting pod/e2e-derive-222aaf00-openshift-default-675df58559-px4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 13:20:19.504046 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:19.503582    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 13:20:19.610897 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:19.610869    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:20.503965 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:20.503918    2532 patch_prober.go:28] interesting pod/e2e-derive-222aaf00-openshift-default-675df58559-px4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 13:20:20.504491 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:20.503987    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 13:20:21.503383 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:21.503343    2532 patch_prober.go:28] interesting pod/e2e-derive-222aaf00-openshift-default-675df58559-px4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 13:20:21.503592 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:21.503403    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 13:20:22.507657 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:22.507615    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:22.508705 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:22.508681    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:40.561606 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.561573    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:40.562106 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.561828    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" podUID="8df9d019-1445-46f9-aff0-ea51fd007c1a" containerName="maas-api" containerID="cri-o://c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd" gracePeriod=30
Jul 21 13:20:40.816023 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.815962    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:40.836570 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.836535    2532 generic.go:356] "Generic (PLEG): container finished" podID="8df9d019-1445-46f9-aff0-ea51fd007c1a" containerID="c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd" exitCode=0
Jul 21 13:20:40.836750 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.836600    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"
Jul 21 13:20:40.836750 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.836605    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" event={"ID":"8df9d019-1445-46f9-aff0-ea51fd007c1a","Type":"ContainerDied","Data":"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"}
Jul 21 13:20:40.836750 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.836730    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578" event={"ID":"8df9d019-1445-46f9-aff0-ea51fd007c1a","Type":"ContainerDied","Data":"a370c955c88acf1c27ab3181d2daedcb2ea29e55a05e017d6b5ab3c350a7db2e"}
Jul 21 13:20:40.836917 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.836762    2532 scope.go:117] "RemoveContainer" containerID="c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"
Jul 21 13:20:40.850965 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.850945    2532 scope.go:117] "RemoveContainer" containerID="c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"
Jul 21 13:20:40.851311 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:20:40.851288    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd\": container with ID starting with c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd not found: ID does not exist" containerID="c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"
Jul 21 13:20:40.851436 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.851317    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd"} err="failed to get container status \"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd\": rpc error: code = NotFound desc = could not find container \"c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd\": container with ID starting with c9877b8203de4041998d38a3700ee4bcd23926d741c0efdb96d41d5f075ab3bd not found: ID does not exist"
Jul 21 13:20:40.981626 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.981598    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27rbz\" (UniqueName: \"kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz\") pod \"8df9d019-1445-46f9-aff0-ea51fd007c1a\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") "
Jul 21 13:20:40.981787 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.981654    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca\") pod \"8df9d019-1445-46f9-aff0-ea51fd007c1a\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") "
Jul 21 13:20:40.981787 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.981778    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls\") pod \"8df9d019-1445-46f9-aff0-ea51fd007c1a\" (UID: \"8df9d019-1445-46f9-aff0-ea51fd007c1a\") "
Jul 21 13:20:40.981993 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.981968    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8df9d019-1445-46f9-aff0-ea51fd007c1a" (UID: "8df9d019-1445-46f9-aff0-ea51fd007c1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:20:40.982104 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.982076    2532 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df9d019-1445-46f9-aff0-ea51fd007c1a-openshift-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:40.983776 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.983756    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz" (OuterVolumeSpecName: "kube-api-access-27rbz") pod "8df9d019-1445-46f9-aff0-ea51fd007c1a" (UID: "8df9d019-1445-46f9-aff0-ea51fd007c1a"). InnerVolumeSpecName "kube-api-access-27rbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:20:40.983880 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:40.983857    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8df9d019-1445-46f9-aff0-ea51fd007c1a" (UID: "8df9d019-1445-46f9-aff0-ea51fd007c1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 13:20:41.083011 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:41.082943    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df9d019-1445-46f9-aff0-ea51fd007c1a-maas-api-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:41.083011 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:41.082968    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27rbz\" (UniqueName: \"kubernetes.io/projected/8df9d019-1445-46f9-aff0-ea51fd007c1a-kube-api-access-27rbz\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:41.167970 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:41.167932    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:41.173169 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:41.173135    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-222aaf00-58bf8c4889-5h578"]
Jul 21 13:20:41.360077 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:41.360005    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df9d019-1445-46f9-aff0-ea51fd007c1a" path="/var/lib/kubelet/pods/8df9d019-1445-46f9-aff0-ea51fd007c1a/volumes"
Jul 21 13:20:45.271959 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:45.271920    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:20:45.272721 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:45.272693    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy" containerID="cri-o://2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f" gracePeriod=30
Jul 21 13:20:50.536600 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.536576    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563525    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563570    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563614    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563685    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563718    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfdsb\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563743    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563769    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563805    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563828    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket\") pod \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\" (UID: \"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1\") "
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.563857    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:20:50.564219 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.564085    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.564944 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.564908    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:20:50.565644 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.565557    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:20:50.565644 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.565620    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:20:50.566002 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.565975    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:20:50.567124 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.566590    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:20:50.567124 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.567006    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:20:50.567903 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.567877    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:20:50.568347 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.568325    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb" (OuterVolumeSpecName: "kube-api-access-nfdsb") pod "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" (UID: "f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1"). InnerVolumeSpecName "kube-api-access-nfdsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:20:50.665073 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665033    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665073 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665058    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665073 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665066    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665073 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665074    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfdsb\" (UniqueName: \"kubernetes.io/projected/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-kube-api-access-nfdsb\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665073 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665083    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665091    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665099    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.665493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.665107    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:20:50.895637 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.895546    2532 generic.go:356] "Generic (PLEG): container finished" podID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerID="2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f" exitCode=0
Jul 21 13:20:50.895637 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.895601    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"
Jul 21 13:20:50.895813 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.895639    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerDied","Data":"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"}
Jul 21 13:20:50.895813 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.895698    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz" event={"ID":"f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1","Type":"ContainerDied","Data":"ef695f0644e674d77f5f90a509d9b86286b7143e1ee4c6e30ba69047a7eaa73c"}
Jul 21 13:20:50.895813 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.895728    2532 scope.go:117] "RemoveContainer" containerID="2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"
Jul 21 13:20:50.905721 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.905705    2532 scope.go:117] "RemoveContainer" containerID="7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"
Jul 21 13:20:50.914144 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.914127    2532 scope.go:117] "RemoveContainer" containerID="2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"
Jul 21 13:20:50.914435 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:20:50.914415    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f\": container with ID starting with 2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f not found: ID does not exist" containerID="2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"
Jul 21 13:20:50.914516 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.914445    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f"} err="failed to get container status \"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f\": rpc error: code = NotFound desc = could not find container \"2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f\": container with ID starting with 2af2c8b085854d1f8cfc4678ab184d95e8b758988c3564062a7c11ee521c488f not found: ID does not exist"
Jul 21 13:20:50.914516 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.914469    2532 scope.go:117] "RemoveContainer" containerID="7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"
Jul 21 13:20:50.914730 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:20:50.914714    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7\": container with ID starting with 7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7 not found: ID does not exist" containerID="7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"
Jul 21 13:20:50.914769 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.914737    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7"} err="failed to get container status \"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7\": rpc error: code = NotFound desc = could not find container \"7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7\": container with ID starting with 7ae8884808785e4c8297a9102d394e263aed02293df49b4221f01adb92e8bdd7 not found: ID does not exist"
Jul 21 13:20:50.919965 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.919937    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:20:50.928014 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:50.927981    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-222aaf00-openshift-default-675df58559-px4pz"]
Jul 21 13:20:51.357942 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:51.357912    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" path="/var/lib/kubelet/pods/f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1/volumes"
Jul 21 13:20:55.458616 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:55.458589    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:20:55.467406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:20:55.467383    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:22:25.022892 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.022815    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:22:25.023403 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023385    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df9d019-1445-46f9-aff0-ea51fd007c1a" containerName="maas-api"
Jul 21 13:22:25.023459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023407    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df9d019-1445-46f9-aff0-ea51fd007c1a" containerName="maas-api"
Jul 21 13:22:25.023459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023431    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:22:25.023459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023439    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:22:25.023459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023452    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:22:25.023585 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023460    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:22:25.023585 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023546    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:22:25.023585 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.023557    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df9d019-1445-46f9-aff0-ea51fd007c1a" containerName="maas-api"
Jul 21 13:22:25.028888 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.028853    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.033074 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.033051    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ea9fc8fd-openshift-default-dockercfg-bg8vw\""
Jul 21 13:22:25.033359 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.033343    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 13:22:25.050926 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.050891    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:22:25.166065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166028    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166068    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166085    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166110    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166143    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166213    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166231    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166254    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcjv\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.166492 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.166304    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267239 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267200    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267262    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267291    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267325    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcjv\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267351    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267631 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267423    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267631 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267451    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267755 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267647    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267755 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267687    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267758    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.267841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.267766    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.268252 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.268221    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.268416 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.268391    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.268553 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.268419    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.270170 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.270134    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.270276 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.270188    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.277008 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.276951    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.277093 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.277064    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcjv\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv\") pod \"e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") " pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.341199 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.341174    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:25.483853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.483824    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:22:25.485039 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:22:25.485011    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7eb1506_93b7_481a_909a_984a9d5c2770.slice/crio-b2967f5e368186e9eeb0ba857adb5ce305ba35da1d455cd194ca27041bcb3c69 WatchSource:0}: Error finding container b2967f5e368186e9eeb0ba857adb5ce305ba35da1d455cd194ca27041bcb3c69: Status 404 returned error can't find the container with id b2967f5e368186e9eeb0ba857adb5ce305ba35da1d455cd194ca27041bcb3c69
Jul 21 13:22:25.487470 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.487441    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:25.487572 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.487500    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:25.487572 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:25.487529    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:26.430366 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:26.430325    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerStarted","Data":"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"}
Jul 21 13:22:26.430756 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:26.430436    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerStarted","Data":"b2967f5e368186e9eeb0ba857adb5ce305ba35da1d455cd194ca27041bcb3c69"}
Jul 21 13:22:26.454342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:26.454290    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podStartSLOduration=2.454276572 podStartE2EDuration="2.454276572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:22:26.451542039 +0000 UTC m=+1891.488572112" watchObservedRunningTime="2026-07-21 13:22:26.454276572 +0000 UTC m=+1891.491306643"
Jul 21 13:22:27.341778 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:27.341747    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:27.347045 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:27.347014    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:27.437484 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:27.437452    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:27.438545 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:27.438525    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:42.439099 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.439065    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 13:22:42.439542 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.439122    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 13:22:42.535788 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.535756    2532 generic.go:356] "Generic (PLEG): container finished" podID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerID="480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a" exitCode=0
Jul 21 13:22:42.535988 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.535835    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerDied","Data":"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"}
Jul 21 13:22:42.536273 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.536256    2532 scope.go:117] "RemoveContainer" containerID="480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"
Jul 21 13:22:42.537269 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.537242    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:42.537368 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.537323    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:42.537431 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:42.537369    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:22:43.544015 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:43.543975    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerStarted","Data":"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"}
Jul 21 13:22:44.341986 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:44.341954    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:44.342198 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:44.342178    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 13:22:44.342279 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:44.342223    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 13:22:45.341952 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:45.341913    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 13:22:45.342490 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:45.341997    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 13:22:46.341917 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:46.341881    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 13:22:46.342095 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:46.341952    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 13:22:47.342047 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:47.342008    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 21 13:22:47.342252 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:47.342064    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 21 13:22:48.345228 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:48.345202    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:48.345607 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:48.345448    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:22:48.346182 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:22:48.346146    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:23:02.305675 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:02.305641    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:23:02.306271 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:02.305929    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" containerID="cri-o://44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02" gracePeriod=30
Jul 21 13:23:03.347894 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:03.347857    2532 patch_prober.go:28] interesting pod/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 13:23:03.348294 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:03.347911    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 13:23:07.567945 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.567888    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:23:07.634280 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634248    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634280 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634285    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634308    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634327    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634372    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634395    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxcjv\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634422    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634445    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634499 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634486    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket\") pod \"f7eb1506-93b7-481a-909a-984a9d5c2770\" (UID: \"f7eb1506-93b7-481a-909a-984a9d5c2770\") "
Jul 21 13:23:07.634841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634545    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:23:07.634841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634783    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:23:07.634841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634789    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:23:07.634841 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634798    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.635044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.634971    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:23:07.635452 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.635427    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:23:07.636873 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.636838    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv" (OuterVolumeSpecName: "kube-api-access-sxcjv") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "kube-api-access-sxcjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:23:07.636975 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.636893    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:23:07.637171 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.637129    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:23:07.637277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.637184    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7eb1506-93b7-481a-909a-984a9d5c2770" (UID: "f7eb1506-93b7-481a-909a-984a9d5c2770"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:23:07.685893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.685862    2532 generic.go:356] "Generic (PLEG): container finished" podID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerID="44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02" exitCode=0
Jul 21 13:23:07.686080 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.685913    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerDied","Data":"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"}
Jul 21 13:23:07.686080 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.685920    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"
Jul 21 13:23:07.686080 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.685957    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc" event={"ID":"f7eb1506-93b7-481a-909a-984a9d5c2770","Type":"ContainerDied","Data":"b2967f5e368186e9eeb0ba857adb5ce305ba35da1d455cd194ca27041bcb3c69"}
Jul 21 13:23:07.686080 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.685979    2532 scope.go:117] "RemoveContainer" containerID="44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"
Jul 21 13:23:07.696393 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.696374    2532 scope.go:117] "RemoveContainer" containerID="480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"
Jul 21 13:23:07.704877 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.704858    2532 scope.go:117] "RemoveContainer" containerID="44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"
Jul 21 13:23:07.705141 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:23:07.705121    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02\": container with ID starting with 44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02 not found: ID does not exist" containerID="44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"
Jul 21 13:23:07.705218 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.705165    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02"} err="failed to get container status \"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02\": rpc error: code = NotFound desc = could not find container \"44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02\": container with ID starting with 44fc032e062acb9a5d2dc8d87d8b56aa65a109df3e46c3858e60f35d1cbb9f02 not found: ID does not exist"
Jul 21 13:23:07.705218 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.705183    2532 scope.go:117] "RemoveContainer" containerID="480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"
Jul 21 13:23:07.705403 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:23:07.705389    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a\": container with ID starting with 480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a not found: ID does not exist" containerID="480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"
Jul 21 13:23:07.705441 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.705408    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a"} err="failed to get container status \"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a\": rpc error: code = NotFound desc = could not find container \"480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a\": container with ID starting with 480159dceb7051def3bd746c9e461d49e0691f0884f7bc9edbc1a384fe12996a not found: ID does not exist"
Jul 21 13:23:07.709665 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.709645    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:23:07.714040 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.714020    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ea9fc8fd-openshift-default-5587b7846c-bgrlc"]
Jul 21 13:23:07.735744 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735727    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7eb1506-93b7-481a-909a-984a9d5c2770-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735747    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735756    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735766    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxcjv\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-kube-api-access-sxcjv\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735775    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735783    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735791    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7eb1506-93b7-481a-909a-984a9d5c2770-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:07.735821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:07.735798    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7eb1506-93b7-481a-909a-984a9d5c2770-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:23:09.358877 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:09.358844    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" path="/var/lib/kubelet/pods/f7eb1506-93b7-481a-909a-984a9d5c2770/volumes"
Jul 21 13:23:22.343520 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343493    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:23:22.343882 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343859    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:23:22.343882 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343870    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:23:22.343968 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343939    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:23:22.343968 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343947    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81baa52-4fdc-40c6-b2e2-5d9d44bfa2c1" containerName="istio-proxy"
Jul 21 13:23:22.343968 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.343962    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:23:22.348299 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.348284    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.351519 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.351501    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 13:23:22.351638 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.351563    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-eee3d688-openshift-default-dockercfg-4fnwv\""
Jul 21 13:23:22.360029 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.360001    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:23:22.459589 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459563    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459593    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459615    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459665    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459704    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459719    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459744    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459806    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h49s\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.459928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.459825    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560783 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560737    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560798    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560841    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560872    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560903    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.560950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560930    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561127 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.560959    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561127 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561031    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h49s\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561127 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561059    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561272 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561146    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561680 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561373    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561680 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561414    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.561680 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561607    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.562013 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.561991    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.563705 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.563685    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.563832 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.563814    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.569843 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.569817    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.570206 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.570183    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h49s\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s\") pod \"e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") " pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.660134 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.660073    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:22.803525 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.803490    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:23:22.807739 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:23:22.807705    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9acbc9a_6860_48a4_b66a_6463ce23af9a.slice/crio-7ca4801554ec7811b9d39bdeb816f70fdd0dadfbc3d4cd8ae34b1f294d78b8fe WatchSource:0}: Error finding container 7ca4801554ec7811b9d39bdeb816f70fdd0dadfbc3d4cd8ae34b1f294d78b8fe: Status 404 returned error can't find the container with id 7ca4801554ec7811b9d39bdeb816f70fdd0dadfbc3d4cd8ae34b1f294d78b8fe
Jul 21 13:23:22.809706 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.809672    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:22.809817 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.809748    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:22.809817 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:22.809792    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:23.779571 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:23.779541    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerStarted","Data":"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"}
Jul 21 13:23:23.780013 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:23.779593    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerStarted","Data":"7ca4801554ec7811b9d39bdeb816f70fdd0dadfbc3d4cd8ae34b1f294d78b8fe"}
Jul 21 13:23:23.802597 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:23.802549    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podStartSLOduration=1.802535218 podStartE2EDuration="1.802535218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:23:23.801211187 +0000 UTC m=+1948.838241262" watchObservedRunningTime="2026-07-21 13:23:23.802535218 +0000 UTC m=+1948.839565292"
Jul 21 13:23:24.660930 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:24.660893    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:24.665893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:24.665867    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:24.785286 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:24.785258    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:24.786120 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:24.786104    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:40.213476 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.212634    2532 patch_prober.go:28] interesting pod/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:48678->10.132.0.67:15021: read: connection reset by peer" start-of-body=
Jul 21 13:23:40.213476 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.212710    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:48678->10.132.0.67:15021: read: connection reset by peer"
Jul 21 13:23:40.880525 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.880491    2532 generic.go:356] "Generic (PLEG): container finished" podID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerID="e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9" exitCode=0
Jul 21 13:23:40.880707 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.880560    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerDied","Data":"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"}
Jul 21 13:23:40.880998 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.880981    2532 scope.go:117] "RemoveContainer" containerID="e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"
Jul 21 13:23:40.881973 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.881949    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:40.882025 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.882013    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:40.882059 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:40.882042    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:23:41.887860 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:41.887825    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerStarted","Data":"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"}
Jul 21 13:23:42.661273 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:42.661232    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:42.661594 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:42.661305    2532 patch_prober.go:28] interesting pod/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 21 13:23:42.661747 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:42.661726    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 21 13:23:43.660797 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:43.660747    2532 patch_prober.go:28] interesting pod/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 21 13:23:43.661361 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:43.660827    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 21 13:23:44.660535 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:44.660488    2532 patch_prober.go:28] interesting pod/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 21 13:23:44.660756 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:44.660565    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 21 13:23:45.660435 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:45.660398    2532 patch_prober.go:28] interesting pod/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 21 13:23:45.661009 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:45.660977    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 21 13:23:46.664480 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:46.664396    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:46.664876 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:46.664731    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:23:46.665436 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:23:46.665416    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:24:55.625736 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:24:55.625700    2532 scope.go:117] "RemoveContainer" containerID="11bcf65bf0d370493c053cc2a038096320d9004358c76947d902b1376b85ab2a"
Jul 21 13:25:25.216357 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:25.216259    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:25:25.216913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:25.216509    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy" containerID="cri-o://18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a" gracePeriod=30
Jul 21 13:25:30.486654 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.486583    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:25:30.492236 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.492205    2532 generic.go:356] "Generic (PLEG): container finished" podID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerID="18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a" exitCode=0
Jul 21 13:25:30.492373 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.492251    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"
Jul 21 13:25:30.492373 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.492288    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerDied","Data":"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"}
Jul 21 13:25:30.492373 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.492352    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz" event={"ID":"b9acbc9a-6860-48a4-b66a-6463ce23af9a","Type":"ContainerDied","Data":"7ca4801554ec7811b9d39bdeb816f70fdd0dadfbc3d4cd8ae34b1f294d78b8fe"}
Jul 21 13:25:30.492493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.492381    2532 scope.go:117] "RemoveContainer" containerID="18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"
Jul 21 13:25:30.505540 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.505523    2532 scope.go:117] "RemoveContainer" containerID="e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"
Jul 21 13:25:30.517278 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.517249    2532 scope.go:117] "RemoveContainer" containerID="18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"
Jul 21 13:25:30.517619 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:25:30.517599    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a\": container with ID starting with 18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a not found: ID does not exist" containerID="18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"
Jul 21 13:25:30.517715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.517628    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a"} err="failed to get container status \"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a\": rpc error: code = NotFound desc = could not find container \"18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a\": container with ID starting with 18d18665a6c74b3253b427eb41d0280ff0f559198d3874ae39709d76adb8d76a not found: ID does not exist"
Jul 21 13:25:30.517715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.517648    2532 scope.go:117] "RemoveContainer" containerID="e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"
Jul 21 13:25:30.517927 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:25:30.517908    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9\": container with ID starting with e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9 not found: ID does not exist" containerID="e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"
Jul 21 13:25:30.517992 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.517937    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9"} err="failed to get container status \"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9\": rpc error: code = NotFound desc = could not find container \"e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9\": container with ID starting with e4befc566144aa7efa1ca39b5eeac70c58aaab15cc6a46e81373b1b5387d2db9 not found: ID does not exist"
Jul 21 13:25:30.582967 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.582941    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.582984    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583004    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583045    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583070    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583141 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583112    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583438 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583188    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583438 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583240    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583438 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583264    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h49s\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s\") pod \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\" (UID: \"b9acbc9a-6860-48a4-b66a-6463ce23af9a\") "
Jul 21 13:25:30.583438 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583269    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:25:30.583438 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583411    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:25:30.583699 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583520    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.583699 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583529    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:25:30.583699 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583538    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.583849 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.583784    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:25:30.584429 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.584404    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:25:30.585583 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.585555    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:25:30.585691 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.585674    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:25:30.585984 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.585947    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s" (OuterVolumeSpecName: "kube-api-access-2h49s") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "kube-api-access-2h49s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:25:30.585984 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.585978    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9acbc9a-6860-48a4-b66a-6463ce23af9a" (UID: "b9acbc9a-6860-48a4-b66a-6463ce23af9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:25:30.684056 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684016    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684056 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684042    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684056 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684051    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684056 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684060    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684056 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684067    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684516 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684076    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h49s\" (UniqueName: \"kubernetes.io/projected/b9acbc9a-6860-48a4-b66a-6463ce23af9a-kube-api-access-2h49s\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.684516 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.684084    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9acbc9a-6860-48a4-b66a-6463ce23af9a-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:25:30.826925 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.826889    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:25:30.830633 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:30.830608    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-eee3d688-openshift-default-b5c4f5479-z45sz"]
Jul 21 13:25:31.358817 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:31.358777    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" path="/var/lib/kubelet/pods/b9acbc9a-6860-48a4-b66a-6463ce23af9a/volumes"
Jul 21 13:25:55.499120 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:55.499086    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:25:55.508082 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:55.508055    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:25:55.647527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:55.647497    2532 scope.go:117] "RemoveContainer" containerID="39d9139941bde01adb00b6c0f27245871ecf91e98f3514f1249d26685e226c40"
Jul 21 13:25:55.656635 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:25:55.656616    2532 scope.go:117] "RemoveContainer" containerID="de2afd28478c5e0d8ec854654d3ed0f29d794bcab80a376fdf43121981e1154e"
Jul 21 13:26:21.344066 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344034    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344452    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344465    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7eb1506-93b7-481a-909a-984a9d5c2770" containerName="istio-proxy"
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344477    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344486    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344509    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.344527 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344515    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.344720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344584    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.344720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.344591    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9acbc9a-6860-48a4-b66a-6463ce23af9a" containerName="istio-proxy"
Jul 21 13:26:21.347273 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.347257    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.350925 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.350905    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d1dafe-openshift-default-dockercfg-9xqwj\""
Jul 21 13:26:21.351133 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.351119    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 13:26:21.365502 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.365482    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:26:21.523037 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523005    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523037 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523041    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523066    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523084    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfv5z\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523125    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523175    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523201    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523220    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.523456 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.523259    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.623913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623843    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.623913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623876    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.623913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623892    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfv5z\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624213 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623918    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624213 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623946    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624213 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.623990    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624213 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624017    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624213 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624127    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624216    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624341    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624401    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624635 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624603    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624746 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624630    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.624799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.624717    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.626277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.626251    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.626561 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.626545    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.634971 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.634949    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.635410 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.635388    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfv5z\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z\") pod \"e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") " pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.657800 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.657781    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:21.800404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.800379    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:26:21.801596 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:26:21.801570    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad633a2e_05db_46e0_8d70_17c37e9a1ddf.slice/crio-a2ff87b288ea387fdba41c382b1b9143063035b105fbfa77a76473fe662f02c3 WatchSource:0}: Error finding container a2ff87b288ea387fdba41c382b1b9143063035b105fbfa77a76473fe662f02c3: Status 404 returned error can't find the container with id a2ff87b288ea387fdba41c382b1b9143063035b105fbfa77a76473fe662f02c3
Jul 21 13:26:21.803579 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.803547    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:21.803639 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.803611    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:21.803672 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:21.803663    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:22.784830 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:22.784792    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerStarted","Data":"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"}
Jul 21 13:26:22.785310 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:22.784876    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerStarted","Data":"a2ff87b288ea387fdba41c382b1b9143063035b105fbfa77a76473fe662f02c3"}
Jul 21 13:26:22.815694 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:22.815636    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podStartSLOduration=1.8156210659999998 podStartE2EDuration="1.815621066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:26:22.812951184 +0000 UTC m=+2127.849981258" watchObservedRunningTime="2026-07-21 13:26:22.815621066 +0000 UTC m=+2127.852651140"
Jul 21 13:26:23.658230 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:23.658203    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:23.664192 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:23.664143    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:23.790434 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:23.790405    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:23.791468 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:23.791446    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:29.847944 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.847905    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:26:29.851523 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.851503    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.855018 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.854995    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ba2d34-openshift-default-dockercfg-8td2x\""
Jul 21 13:26:29.867619 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.867589    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:26:29.902831 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902798    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.902831 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902840    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902876    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902902    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rffx\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902920    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903065 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.902948    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903236 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.903065    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903236 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.903097    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:29.903236 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:29.903115    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004440 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004406    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004451    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004494    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004513    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004529    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004559    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004589    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004625    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.004726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.004651    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rffx\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.005197 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.005060    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.005197 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.005082    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.005197 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.005173    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.005359 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.005218    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.005413 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.005395    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.007139 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.007123    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.007248 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.007231    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.017201 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.017178    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.017331 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.017313    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rffx\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx\") pod \"e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") " pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.163731 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.163633    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:30.320391 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.320355    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:26:30.321431 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:26:30.321403    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98c0052_6f97_454e_bbec_0ecc9c1e2c58.slice/crio-0190144f9e2d65e93415dec48a0d17a7fdbfcedc53d5f70a4be54844b0794277 WatchSource:0}: Error finding container 0190144f9e2d65e93415dec48a0d17a7fdbfcedc53d5f70a4be54844b0794277: Status 404 returned error can't find the container with id 0190144f9e2d65e93415dec48a0d17a7fdbfcedc53d5f70a4be54844b0794277
Jul 21 13:26:30.323865 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.323836    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:30.323940 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.323905    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:30.323988 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.323935    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:30.831423 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.831387    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerStarted","Data":"c6ab765d78abea45a7012bbc96c9e50d5bc27d844644dcad2f93e6b919e6e754"}
Jul 21 13:26:30.831641 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.831450    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerStarted","Data":"0190144f9e2d65e93415dec48a0d17a7fdbfcedc53d5f70a4be54844b0794277"}
Jul 21 13:26:30.862983 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:30.862891    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podStartSLOduration=1.862873715 podStartE2EDuration="1.862873715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:26:30.860696911 +0000 UTC m=+2135.897726986" watchObservedRunningTime="2026-07-21 13:26:30.862873715 +0000 UTC m=+2135.899903791"
Jul 21 13:26:31.164898 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:31.164801    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:31.176884 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:31.176856    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:31.836737 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:31.836702    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:31.837726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:31.837706    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:38.792742 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.792710    2532 patch_prober.go:28] interesting pod/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 13:26:38.793212 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.792768    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 13:26:38.887981 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.887939    2532 generic.go:356] "Generic (PLEG): container finished" podID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerID="fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728" exitCode=0
Jul 21 13:26:38.888370 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.888343    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerDied","Data":"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"}
Jul 21 13:26:38.888997 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.888978    2532 scope.go:117] "RemoveContainer" containerID="fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"
Jul 21 13:26:38.890361 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.890334    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:38.890467 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.890417    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:38.890532 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:38.890466    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:39.901572 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:39.901526    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerStarted","Data":"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"}
Jul 21 13:26:40.658358 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:40.658329    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:40.658547 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:40.658485    2532 patch_prober.go:28] interesting pod/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 13:26:40.658547 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:40.658529    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 13:26:41.659106 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:41.659076    2532 patch_prober.go:28] interesting pod/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 13:26:41.659628 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:41.659601    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 13:26:42.658713 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:42.658632    2532 patch_prober.go:28] interesting pod/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 13:26:42.658713 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:42.658687    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 13:26:43.658097 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:43.658065    2532 patch_prober.go:28] interesting pod/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 21 13:26:43.658596 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:43.658123    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 21 13:26:44.662128 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:44.662086    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:44.662619 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:44.662391    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:44.663025 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:44.663006    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:26:45.941445 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.941413    2532 generic.go:356] "Generic (PLEG): container finished" podID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerID="c6ab765d78abea45a7012bbc96c9e50d5bc27d844644dcad2f93e6b919e6e754" exitCode=0
Jul 21 13:26:45.941871 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.941484    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerDied","Data":"c6ab765d78abea45a7012bbc96c9e50d5bc27d844644dcad2f93e6b919e6e754"}
Jul 21 13:26:45.942037 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.942020    2532 scope.go:117] "RemoveContainer" containerID="c6ab765d78abea45a7012bbc96c9e50d5bc27d844644dcad2f93e6b919e6e754"
Jul 21 13:26:45.942995 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.942968    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:45.943090 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.943034    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:45.943090 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:45.943067    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:26:46.837531 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:46.837451    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:46.950233 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:46.950195    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerStarted","Data":"9708e6fc8ae0204b29b14e73689f8562d251a3256ae2f3ca1438f45e3befebb4"}
Jul 21 13:26:47.164757 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:47.164667    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:47.166201 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:47.166172    2532 patch_prober.go:28] interesting pod/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 13:26:47.166417 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:47.166391    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 13:26:48.165493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:48.164997    2532 patch_prober.go:28] interesting pod/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 13:26:48.165493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:48.165067    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 13:26:49.164126 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:49.164088    2532 patch_prober.go:28] interesting pod/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 13:26:49.164443 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:49.164413    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 13:26:50.164557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:50.164519    2532 patch_prober.go:28] interesting pod/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 21 13:26:50.165121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:50.165095    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 21 13:26:51.169479 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:51.169445    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:51.169887 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:51.169855    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:26:51.171001 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:26:51.170981    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:28:13.219376 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.219342    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"]
Jul 21 13:28:13.222989 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.222971    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:13.226131 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.226113    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:28:13.232702 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.232681    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"]
Jul 21 13:28:13.342798 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.342747    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg\" (UID: \"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:13.443742 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.443712    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg\" (UID: \"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:13.444493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.444476    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg\" (UID: \"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:13.534344 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.534257    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:13.880281 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:13.880257    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"]
Jul 21 13:28:13.881846 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:28:13.881814    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e625998_ecb5_4cb3_a5d4_e52ecbea24f2.slice/crio-0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6 WatchSource:0}: Error finding container 0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6: Status 404 returned error can't find the container with id 0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6
Jul 21 13:28:14.437743 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:14.437656    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg" event={"ID":"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2","Type":"ContainerStarted","Data":"0acad9ec82b5004dbab76d4c8b00f75f24bda2dfc77b89ba3279de1e9ecc3820"}
Jul 21 13:28:14.437743 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:14.437716    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg" event={"ID":"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2","Type":"ContainerStarted","Data":"0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6"}
Jul 21 13:28:14.457264 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:14.457201    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg" podStartSLOduration=1.457184989 podStartE2EDuration="1.457184989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:28:14.454123196 +0000 UTC m=+2239.491153269" watchObservedRunningTime="2026-07-21 13:28:14.457184989 +0000 UTC m=+2239.494215060"
Jul 21 13:28:15.444962 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:15.444925    2532 generic.go:356] "Generic (PLEG): container finished" podID="7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" containerID="0acad9ec82b5004dbab76d4c8b00f75f24bda2dfc77b89ba3279de1e9ecc3820" exitCode=0
Jul 21 13:28:15.445383 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:15.445011    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg" event={"ID":"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2","Type":"ContainerDied","Data":"0acad9ec82b5004dbab76d4c8b00f75f24bda2dfc77b89ba3279de1e9ecc3820"}
Jul 21 13:28:16.582271 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:16.582248    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:16.672313 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:16.672287    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca\") pod \"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2\" (UID: \"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2\") "
Jul 21 13:28:16.672627 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:16.672606    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" (UID: "7e625998-ecb5-4cb3-a5d4-e52ecbea24f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:28:16.773167 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:16.773084    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:17.457819 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:17.457791    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"
Jul 21 13:28:17.457992 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:17.457831    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg" event={"ID":"7e625998-ecb5-4cb3-a5d4-e52ecbea24f2","Type":"ContainerDied","Data":"0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6"}
Jul 21 13:28:17.457992 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:17.457883    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e4e7c05c275da8389d4e1cea8ca39d62248afd9b2139c19b9efe767651555e6"
Jul 21 13:28:28.325682 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:28.325644    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"]
Jul 21 13:28:28.328454 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:28.328432    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d1dafe-r99cg"]
Jul 21 13:28:29.358762 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:29.358726    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" path="/var/lib/kubelet/pods/7e625998-ecb5-4cb3-a5d4-e52ecbea24f2/volumes"
Jul 21 13:28:35.178401 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:35.178366    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:28:35.178900 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:35.178588    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy" containerID="cri-o://32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c" gracePeriod=30
Jul 21 13:28:40.436652 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.436627    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:28:40.585192 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585122    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfv5z\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585200    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585238    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585296    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585321    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585341    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585363    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585727 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585417    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585727 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585441    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs\") pod \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\" (UID: \"ad633a2e-05db-46e0-8d70-17c37e9a1ddf\") "
Jul 21 13:28:40.585727 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585548    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:40.585889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585796    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:40.585889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585806    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:28:40.585889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585804    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.586053 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.585971    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:40.586551 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.586529    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:40.587678 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.587656    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:28:40.587816 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.587711    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:28:40.588035 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.588017    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z" (OuterVolumeSpecName: "kube-api-access-bfv5z") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "kube-api-access-bfv5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:28:40.588113 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.588086    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad633a2e-05db-46e0-8d70-17c37e9a1ddf" (UID: "ad633a2e-05db-46e0-8d70-17c37e9a1ddf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:28:40.602602 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.602577    2532 generic.go:356] "Generic (PLEG): container finished" podID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerID="32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c" exitCode=0
Jul 21 13:28:40.602720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.602628    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"
Jul 21 13:28:40.602720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.602634    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerDied","Data":"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"}
Jul 21 13:28:40.602720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.602686    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx" event={"ID":"ad633a2e-05db-46e0-8d70-17c37e9a1ddf","Type":"ContainerDied","Data":"a2ff87b288ea387fdba41c382b1b9143063035b105fbfa77a76473fe662f02c3"}
Jul 21 13:28:40.602720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.602710    2532 scope.go:117] "RemoveContainer" containerID="32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"
Jul 21 13:28:40.612631 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.612614    2532 scope.go:117] "RemoveContainer" containerID="fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"
Jul 21 13:28:40.621853 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.621832    2532 scope.go:117] "RemoveContainer" containerID="32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"
Jul 21 13:28:40.622100 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:28:40.622083    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c\": container with ID starting with 32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c not found: ID does not exist" containerID="32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"
Jul 21 13:28:40.622135 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.622110    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c"} err="failed to get container status \"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c\": rpc error: code = NotFound desc = could not find container \"32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c\": container with ID starting with 32048a91862329f7001f6452a9d5d90b2f3bcbd97082b0dee889fcf1541b2c7c not found: ID does not exist"
Jul 21 13:28:40.622135 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.622127    2532 scope.go:117] "RemoveContainer" containerID="fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"
Jul 21 13:28:40.622381 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:28:40.622365    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728\": container with ID starting with fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728 not found: ID does not exist" containerID="fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"
Jul 21 13:28:40.622415 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.622389    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728"} err="failed to get container status \"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728\": rpc error: code = NotFound desc = could not find container \"fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728\": container with ID starting with fb8706bbd319ae94d52e1c396161b6e07a06e3c41e3960573fdc1d8db8e75728 not found: ID does not exist"
Jul 21 13:28:40.629322 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.629298    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:28:40.637178 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.637144    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d1dafe-openshift-default-b795cf487-s4jbx"]
Jul 21 13:28:40.686568 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686534    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686568 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686559    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686568 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686568    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686568 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686575    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686829 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686585    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686829 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686593    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfv5z\" (UniqueName: \"kubernetes.io/projected/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-kube-api-access-bfv5z\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686829 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686601    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:40.686829 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:40.686610    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad633a2e-05db-46e0-8d70-17c37e9a1ddf-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:28:41.357858 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:41.357828    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" path="/var/lib/kubelet/pods/ad633a2e-05db-46e0-8d70-17c37e9a1ddf/volumes"
Jul 21 13:28:57.585854 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:57.585823    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:28:57.586292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:57.586045    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy" containerID="cri-o://9708e6fc8ae0204b29b14e73689f8562d251a3256ae2f3ca1438f45e3befebb4" gracePeriod=30
Jul 21 13:28:58.450752 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.450722    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:28:58.451113 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451101    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451172 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451115    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451172 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451126    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451172 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451131    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451172 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451146    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" containerName="revoke-keys"
Jul 21 13:28:58.451303 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451178    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" containerName="revoke-keys"
Jul 21 13:28:58.451303 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451249    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451303 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451257    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad633a2e-05db-46e0-8d70-17c37e9a1ddf" containerName="istio-proxy"
Jul 21 13:28:58.451303 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.451263    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e625998-ecb5-4cb3-a5d4-e52ecbea24f2" containerName="revoke-keys"
Jul 21 13:28:58.455780 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.455765    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.458774 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.458756    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b6860c-openshift-default-dockercfg-j72ks\""
Jul 21 13:28:58.471470 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.471448    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:28:58.536522 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536482    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536585    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536628    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jqn\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536658    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536720 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536708    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536974 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536806    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536974 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536835    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.536974 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536878    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.537075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.536969    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.637987 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.637947    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.637987 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.637989    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638116    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638233    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638264    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638323    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638373    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jqn\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638414    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638451    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638555 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638470    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638939 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638667    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638939 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638704    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.638939 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.638737    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.639231 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.639210    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.640736 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.640709    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.640856 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.640744    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.648789 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.648766    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.648934 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.648833    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jqn\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn\") pod \"e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") " pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.766974 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.766886    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:28:58.940646 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.940612    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:28:58.942138 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:28:58.942111    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dada8f_3083_488e_baeb_1a34474138a3.slice/crio-737dea92b2e435e225e06f4cf78fac38c80d0a0d47d17692d6eebdaed0b30930 WatchSource:0}: Error finding container 737dea92b2e435e225e06f4cf78fac38c80d0a0d47d17692d6eebdaed0b30930: Status 404 returned error can't find the container with id 737dea92b2e435e225e06f4cf78fac38c80d0a0d47d17692d6eebdaed0b30930
Jul 21 13:28:58.944446 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.944406    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:28:58.944537 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.944518    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:28:58.944590 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:58.944575    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:28:59.712252 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:59.712213    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerStarted","Data":"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"}
Jul 21 13:28:59.712676 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:59.712270    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerStarted","Data":"737dea92b2e435e225e06f4cf78fac38c80d0a0d47d17692d6eebdaed0b30930"}
Jul 21 13:28:59.747059 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:59.747011    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podStartSLOduration=1.7469973890000001 podStartE2EDuration="1.746997389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:28:59.745440174 +0000 UTC m=+2284.782470250" watchObservedRunningTime="2026-07-21 13:28:59.746997389 +0000 UTC m=+2284.784027463"
Jul 21 13:28:59.767168 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:28:59.767127    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:00.772647 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:00.772621    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:01.725813 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:01.725783    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:01.726704 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:01.726684    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:02.734599 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.734562    2532 generic.go:356] "Generic (PLEG): container finished" podID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerID="9708e6fc8ae0204b29b14e73689f8562d251a3256ae2f3ca1438f45e3befebb4" exitCode=0
Jul 21 13:29:02.735032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.734630    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerDied","Data":"9708e6fc8ae0204b29b14e73689f8562d251a3256ae2f3ca1438f45e3befebb4"}
Jul 21 13:29:02.735032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.734688    2532 scope.go:117] "RemoveContainer" containerID="c6ab765d78abea45a7012bbc96c9e50d5bc27d844644dcad2f93e6b919e6e754"
Jul 21 13:29:02.855124 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.855071    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:29:02.979505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979480    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979527    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979549    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979570    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979608    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rffx\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979626    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979658    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.979688 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979682    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.980081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979720    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo\") pod \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\" (UID: \"d98c0052-6f97-454e-bbec-0ecc9c1e2c58\") "
Jul 21 13:29:02.980081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979764    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:02.980081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979939    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:02.980081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979957    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:29:02.980081 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.979965    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:02.980373 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.980116    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:02.980605 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.980560    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data" (OuterVolumeSpecName: "istio-data") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:02.982134 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.982105    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx" (OuterVolumeSpecName: "kube-api-access-2rffx") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "kube-api-access-2rffx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:29:02.982243 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.982206    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:29:02.982446 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.982418    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:02.982543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:02.982444    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token" (OuterVolumeSpecName: "istio-token") pod "d98c0052-6f97-454e-bbec-0ecc9c1e2c58" (UID: "d98c0052-6f97-454e-bbec-0ecc9c1e2c58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:29:03.081486 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081454    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081486 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081480    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081486 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081490    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081708 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081498    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081708 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081506    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rffx\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-kube-api-access-2rffx\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081708 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081516    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081708 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081524    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.081708 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.081532    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c0052-6f97-454e-bbec-0ecc9c1e2c58-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:03.741220 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.741192    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"
Jul 21 13:29:03.741652 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.741216    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4" event={"ID":"d98c0052-6f97-454e-bbec-0ecc9c1e2c58","Type":"ContainerDied","Data":"0190144f9e2d65e93415dec48a0d17a7fdbfcedc53d5f70a4be54844b0794277"}
Jul 21 13:29:03.741652 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.741282    2532 scope.go:117] "RemoveContainer" containerID="9708e6fc8ae0204b29b14e73689f8562d251a3256ae2f3ca1438f45e3befebb4"
Jul 21 13:29:03.762878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.762857    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:29:03.769978 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:03.769956    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ba2d34-openshift-default-58fd9ddf99-gzkh4"]
Jul 21 13:29:05.358203 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:05.358173    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" path="/var/lib/kubelet/pods/d98c0052-6f97-454e-bbec-0ecc9c1e2c58/volumes"
Jul 21 13:29:07.034422 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.034388    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:29:07.034946 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.034926    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:29:07.035035 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.034949    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:29:07.035092 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.035082    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:29:07.035144 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.035096    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:29:07.038284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.038263    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.041266 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.041243    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f114ec-openshift-default-dockercfg-hf2qf\""
Jul 21 13:29:07.059532 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.059512    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:29:07.116045 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116010    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116184 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116054    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116184 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116070    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116184 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116143    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116298 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116197    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116298 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116253    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116298 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116281    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116391 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116304    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.116391 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.116348    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.217682 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217652    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.217844 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217694    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.217928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217835    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.217928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217878    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217935    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217961    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.217993    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218044 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218019    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218062    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218099    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218222    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218449 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218338    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218449 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218379    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.218786 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.218769    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.220286 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.220265    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.220577 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.220555    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.226883 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.226856    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.227251 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.227232    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn\") pod \"e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") " pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.348756 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.348669    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:07.508338 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.508307    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:29:07.509536 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:29:07.509511    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8395fa14_7025_4094_a741_a6a3eb1ebd3b.slice/crio-1177bc976b60186eb8aaaea59e3cacaf1262db98b3765f9edd3d80b06f45dd8f WatchSource:0}: Error finding container 1177bc976b60186eb8aaaea59e3cacaf1262db98b3765f9edd3d80b06f45dd8f: Status 404 returned error can't find the container with id 1177bc976b60186eb8aaaea59e3cacaf1262db98b3765f9edd3d80b06f45dd8f
Jul 21 13:29:07.511710 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.511677    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:07.511810 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.511750    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:07.511810 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.511781    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:07.772441 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.772401    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerStarted","Data":"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"}
Jul 21 13:29:07.772629 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.772472    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerStarted","Data":"1177bc976b60186eb8aaaea59e3cacaf1262db98b3765f9edd3d80b06f45dd8f"}
Jul 21 13:29:07.806118 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:07.806059    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podStartSLOduration=1.806043185 podStartE2EDuration="1.806043185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:29:07.805763885 +0000 UTC m=+2292.842793962" watchObservedRunningTime="2026-07-21 13:29:07.806043185 +0000 UTC m=+2292.843073260"
Jul 21 13:29:08.349339 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:08.349297    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:08.354752 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:08.354725    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:08.777995 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:08.777966    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:08.778858 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:08.778843    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:17.062533 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.061923    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": read tcp 10.132.0.2:55318->10.132.0.71:15021: read: connection reset by peer" start-of-body=
Jul 21 13:29:17.062533 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.062014    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": read tcp 10.132.0.2:55318->10.132.0.71:15021: read: connection reset by peer"
Jul 21 13:29:17.834132 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.834096    2532 generic.go:356] "Generic (PLEG): container finished" podID="f6dada8f-3083-488e-baeb-1a34474138a3" containerID="26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f" exitCode=0
Jul 21 13:29:17.834335 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.834180    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerDied","Data":"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"}
Jul 21 13:29:17.834590 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.834573    2532 scope.go:117] "RemoveContainer" containerID="26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"
Jul 21 13:29:17.835575 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.835548    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:17.835670 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.835614    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:17.835670 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:17.835647    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:18.846294 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:18.846249    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerStarted","Data":"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"}
Jul 21 13:29:19.767653 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:19.767612    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:19.767867 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:19.767732    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 13:29:19.767867 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:19.767787    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 13:29:20.767745 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:20.767713    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 13:29:20.768393 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:20.768346    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 13:29:21.767655 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:21.767615    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 13:29:21.767863 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:21.767694    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 13:29:22.768032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:22.767558    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 21 13:29:22.768032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:22.767629    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 21 13:29:23.771808 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:23.771773    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:23.772330 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:23.772191    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:23.772981 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:23.772959    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:24.819362 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:24.819311    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 13:29:24.819892 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:24.819377    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 13:29:26.900316 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.900274    2532 generic.go:356] "Generic (PLEG): container finished" podID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerID="ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af" exitCode=0
Jul 21 13:29:26.900765 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.900349    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerDied","Data":"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"}
Jul 21 13:29:26.900765 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.900720    2532 scope.go:117] "RemoveContainer" containerID="ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"
Jul 21 13:29:26.901836 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.901807    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:26.901902 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.901879    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:26.901939 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:26.901910    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:29:27.907625 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:27.907589    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerStarted","Data":"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"}
Jul 21 13:29:28.349682 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:28.349650    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:28.349863 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:28.349843    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 13:29:28.349909 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:28.349888    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 13:29:29.349538 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:29.349506    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 13:29:29.349943 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:29.349562    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 13:29:30.349956 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:30.349916    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 13:29:30.350374 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:30.349975    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 13:29:31.350031 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:31.349994    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 21 13:29:31.350457 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:31.350047    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 21 13:29:32.353166 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:32.353122    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:32.353595 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:32.353413    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:32.353989 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:32.353974    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:29:49.013284 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:49.013206    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:29:49.013761 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:49.013464    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" containerID="cri-o://78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d" gracePeriod=30
Jul 21 13:29:53.774333 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:53.774294    2532 patch_prober.go:28] interesting pod/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 21 13:29:53.774740 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:53.774364    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 13:29:54.264912 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.264889    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:54.330543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330449    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330525    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330556    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330589    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330677    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330707    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2jqn\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330713    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330730    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.330799 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330754    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.331189 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330811    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo\") pod \"f6dada8f-3083-488e-baeb-1a34474138a3\" (UID: \"f6dada8f-3083-488e-baeb-1a34474138a3\") "
Jul 21 13:29:54.331189 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330958    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:54.331189 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.330968    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:29:54.331189 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331055    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:54.331458 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331427    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.331458 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331453    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.331590 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331468    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.331590 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331479    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6dada8f-3083-488e-baeb-1a34474138a3-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.331685 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.331586    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:54.332910 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.332888    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:29:54.333018 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.332903    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:29:54.333443 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.333422    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn" (OuterVolumeSpecName: "kube-api-access-d2jqn") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "kube-api-access-d2jqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:29:54.333551 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.333532    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6dada8f-3083-488e-baeb-1a34474138a3" (UID: "f6dada8f-3083-488e-baeb-1a34474138a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:29:54.432164 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.432131    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.432306 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.432188    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2jqn\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-kube-api-access-d2jqn\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.432306 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.432201    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6dada8f-3083-488e-baeb-1a34474138a3-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.432306 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.432214    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6dada8f-3083-488e-baeb-1a34474138a3-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:54.432306 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:54.432225    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6dada8f-3083-488e-baeb-1a34474138a3-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:29:55.063998 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.063957    2532 generic.go:356] "Generic (PLEG): container finished" podID="f6dada8f-3083-488e-baeb-1a34474138a3" containerID="78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d" exitCode=0
Jul 21 13:29:55.064402 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.064026    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"
Jul 21 13:29:55.064402 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.064029    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerDied","Data":"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"}
Jul 21 13:29:55.064402 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.064092    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4" event={"ID":"f6dada8f-3083-488e-baeb-1a34474138a3","Type":"ContainerDied","Data":"737dea92b2e435e225e06f4cf78fac38c80d0a0d47d17692d6eebdaed0b30930"}
Jul 21 13:29:55.064402 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.064124    2532 scope.go:117] "RemoveContainer" containerID="78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"
Jul 21 13:29:55.074099 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.074077    2532 scope.go:117] "RemoveContainer" containerID="26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"
Jul 21 13:29:55.082324 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.082306    2532 scope.go:117] "RemoveContainer" containerID="78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"
Jul 21 13:29:55.082572 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:29:55.082552    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d\": container with ID starting with 78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d not found: ID does not exist" containerID="78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"
Jul 21 13:29:55.082652 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.082583    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d"} err="failed to get container status \"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d\": rpc error: code = NotFound desc = could not find container \"78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d\": container with ID starting with 78dd41270165f3e8cb7980f5a035da4459f1c7e72accb43cbd8fc16de7303a7d not found: ID does not exist"
Jul 21 13:29:55.082652 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.082604    2532 scope.go:117] "RemoveContainer" containerID="26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"
Jul 21 13:29:55.082854 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:29:55.082837    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f\": container with ID starting with 26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f not found: ID does not exist" containerID="26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"
Jul 21 13:29:55.082891 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.082861    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f"} err="failed to get container status \"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f\": rpc error: code = NotFound desc = could not find container \"26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f\": container with ID starting with 26a31fe3ac3300d55f7bf4910692555390742a2aeb6230fcf4443b7ce1e3724f not found: ID does not exist"
Jul 21 13:29:55.093764 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.093745    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:29:55.104705 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.101230    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b6860c-openshift-default-7995bfcf57-p7sh4"]
Jul 21 13:29:55.359494 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:29:55.359423    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" path="/var/lib/kubelet/pods/f6dada8f-3083-488e-baeb-1a34474138a3/volumes"
Jul 21 13:30:16.292684 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:16.292641    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:30:16.293344 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:16.292849    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" containerID="cri-o://e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60" gracePeriod=30
Jul 21 13:30:17.243921 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.243892    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244328    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244346    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244358    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244366    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98c0052-6f97-454e-bbec-0ecc9c1e2c58" containerName="istio-proxy"
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244379    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.244356 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244387    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.244847 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244524    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.244847 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.244555    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dada8f-3083-488e-baeb-1a34474138a3" containerName="istio-proxy"
Jul 21 13:30:17.247921 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.247900    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.254022 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.253999    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3af280-openshift-default-dockercfg-72qxw\""
Jul 21 13:30:17.265019 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.264993    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:30:17.333762 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333729    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.333762 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333766    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333796    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333848    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvr7l\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333865    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333909    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.333928    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.334030    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.334404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.334067    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.356088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.356042    2532 patch_prober.go:28] interesting pod/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 13:30:17.356253 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.356122    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 13:30:17.434607 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434578    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434607 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434614    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvr7l\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434636    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434690    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434718    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434781    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434819    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434854    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.434878 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.434879    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.435391 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.435365    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.435477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.435399    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.435477 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.435452    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.435589 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.435563    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.435845 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.435817    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.437505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.437479    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.437844 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.437821    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.446018 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.445996    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.446193 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.446140    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvr7l\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l\") pod \"e2e-shared-a-3af280-openshift-default-867bff9667-892xg\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") " pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.558581 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.558466    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:17.716633 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.716598    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:30:17.718112 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:30:17.718083    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae8c800_fd2c_4170_a9c7_ee7d8b8a5d4e.slice/crio-3f36342214fabd7cac9db28084b61c4fe535133db89cc102f261ab6b1ba151e5 WatchSource:0}: Error finding container 3f36342214fabd7cac9db28084b61c4fe535133db89cc102f261ab6b1ba151e5: Status 404 returned error can't find the container with id 3f36342214fabd7cac9db28084b61c4fe535133db89cc102f261ab6b1ba151e5
Jul 21 13:30:17.720292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.720256    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:17.720401 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.720324    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:17.720401 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:17.720351    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:18.191208 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:18.191168    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerStarted","Data":"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"}
Jul 21 13:30:18.191466 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:18.191226    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerStarted","Data":"3f36342214fabd7cac9db28084b61c4fe535133db89cc102f261ab6b1ba151e5"}
Jul 21 13:30:18.214669 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:18.214626    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podStartSLOduration=1.21461028 podStartE2EDuration="1.21461028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:30:18.213887107 +0000 UTC m=+2363.250917185" watchObservedRunningTime="2026-07-21 13:30:18.21461028 +0000 UTC m=+2363.251640353"
Jul 21 13:30:18.558950 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:18.558918    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:18.565072 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:18.565043    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:19.196868 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:19.196836    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:19.197938 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:19.197917    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:21.557490 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.557433    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:30:21.674231 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674202    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674248    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674274    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674316    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674362    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674385    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674447 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674436    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674883 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674474    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674883 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674509    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token\") pod \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\" (UID: \"8395fa14-7025-4094-a741-a6a3eb1ebd3b\") "
Jul 21 13:30:21.674993 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.674944    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:30:21.675206 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.675184    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:30:21.675291 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.675194    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:30:21.675291 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.675260    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:30:21.675573 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.675542    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:30:21.677281 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.677255    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:30:21.677452 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.677428    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:30:21.677849 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.677821    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:30:21.678229 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.678203    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn" (OuterVolumeSpecName: "kube-api-access-4zswn") pod "8395fa14-7025-4094-a741-a6a3eb1ebd3b" (UID: "8395fa14-7025-4094-a741-a6a3eb1ebd3b"). InnerVolumeSpecName "kube-api-access-4zswn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:30:21.775726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775690    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.775726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775719    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.775726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775727    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-kube-api-access-4zswn\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.775726 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775737    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.776088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775746    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.776088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775754    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.776088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775761    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.776088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775769    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8395fa14-7025-4094-a741-a6a3eb1ebd3b-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:21.776088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:21.775776    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8395fa14-7025-4094-a741-a6a3eb1ebd3b-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:30:22.217055 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.217020    2532 generic.go:356] "Generic (PLEG): container finished" podID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerID="e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60" exitCode=0
Jul 21 13:30:22.217262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.217088    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"
Jul 21 13:30:22.217262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.217092    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerDied","Data":"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"}
Jul 21 13:30:22.217262 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.217242    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57" event={"ID":"8395fa14-7025-4094-a741-a6a3eb1ebd3b","Type":"ContainerDied","Data":"1177bc976b60186eb8aaaea59e3cacaf1262db98b3765f9edd3d80b06f45dd8f"}
Jul 21 13:30:22.217391 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.217266    2532 scope.go:117] "RemoveContainer" containerID="e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"
Jul 21 13:30:22.227068 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.227052    2532 scope.go:117] "RemoveContainer" containerID="ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"
Jul 21 13:30:22.235753 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.235736    2532 scope.go:117] "RemoveContainer" containerID="e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"
Jul 21 13:30:22.236043 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:30:22.236023    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60\": container with ID starting with e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60 not found: ID does not exist" containerID="e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"
Jul 21 13:30:22.236099 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.236052    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60"} err="failed to get container status \"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60\": rpc error: code = NotFound desc = could not find container \"e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60\": container with ID starting with e0698925142e9bc0e1908b7f8a48f00939713761dc65f580fdb7ff1e7f09bd60 not found: ID does not exist"
Jul 21 13:30:22.236099 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.236070    2532 scope.go:117] "RemoveContainer" containerID="ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"
Jul 21 13:30:22.236332 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:30:22.236315    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af\": container with ID starting with ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af not found: ID does not exist" containerID="ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"
Jul 21 13:30:22.236381 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.236339    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af"} err="failed to get container status \"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af\": rpc error: code = NotFound desc = could not find container \"ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af\": container with ID starting with ba5e6bdd54aa2c6316f70426a83ba640f70190865aab3e48101407358ec6c0af not found: ID does not exist"
Jul 21 13:30:22.242612 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.242586    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:30:22.244784 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:22.244763    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f114ec-openshift-default-767bfb4b45-pkw57"]
Jul 21 13:30:23.357845 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:23.357813    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" path="/var/lib/kubelet/pods/8395fa14-7025-4094-a741-a6a3eb1ebd3b/volumes"
Jul 21 13:30:25.273814 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.273774    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:30:25.274285 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.274192    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:30:25.274285 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.274203    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:30:25.274285 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.274283    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:30:25.274388 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.274291    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:30:25.278790 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.278774    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.283374 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.283354    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2df168-openshift-default-dockercfg-fnj6j\""
Jul 21 13:30:25.297959 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.297930    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:30:25.406579 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406547    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406604    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406628    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406648    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406672    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406713    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406741    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406760 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406758    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxc5m\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.406993 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.406776    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508098 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508070    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508098 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508101    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxc5m\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508412 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508139    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508568 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508545    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508645 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508599    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508703 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508649    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508703 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508680    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508803 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508715    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508803 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508759    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.508955 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508815    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.509006 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.508980    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.509361 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.509331    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.509485 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.509391    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.509552 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.509528    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.510902 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.510872    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.511292 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.511270    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.519807 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.519779    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.520128 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.520109    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxc5m\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m\") pod \"e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") " pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.589273 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.589181    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:25.750715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.750679    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:30:25.751692 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:30:25.751672    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e5dbce_0d41_49ab_a128_64596b407f12.slice/crio-2a530478a5317580906a1752bde3d363e071230faf2e25db8c8d93db2d1b29c7 WatchSource:0}: Error finding container 2a530478a5317580906a1752bde3d363e071230faf2e25db8c8d93db2d1b29c7: Status 404 returned error can't find the container with id 2a530478a5317580906a1752bde3d363e071230faf2e25db8c8d93db2d1b29c7
Jul 21 13:30:25.753822 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.753789    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:25.753907 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.753857    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:25.753907 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:25.753899    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:26.248482 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:26.248437    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerStarted","Data":"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"}
Jul 21 13:30:26.248695 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:26.248519    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerStarted","Data":"2a530478a5317580906a1752bde3d363e071230faf2e25db8c8d93db2d1b29c7"}
Jul 21 13:30:26.275024 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:26.274970    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podStartSLOduration=1.274954255 podStartE2EDuration="1.274954255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:30:26.273952536 +0000 UTC m=+2371.310982611" watchObservedRunningTime="2026-07-21 13:30:26.274954255 +0000 UTC m=+2371.311984328"
Jul 21 13:30:26.589824 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:26.589737    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:26.594904 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:26.594879    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:27.254072 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:27.254040    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:27.255178 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:27.255138    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:35.237338 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:35.237297    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 13:30:35.237742 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:35.237373    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 13:30:36.316408 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.316323    2532 generic.go:356] "Generic (PLEG): container finished" podID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerID="b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0" exitCode=0
Jul 21 13:30:36.316408 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.316396    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerDied","Data":"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"}
Jul 21 13:30:36.316851 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.316762    2532 scope.go:117] "RemoveContainer" containerID="b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"
Jul 21 13:30:36.317763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.317737    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:36.317820 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.317801    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:36.317859 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:36.317836    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:37.324956 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:37.324922    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerStarted","Data":"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"}
Jul 21 13:30:37.559556 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:37.559522    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:37.559763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:37.559743    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 21 13:30:37.559813 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:37.559787    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 21 13:30:38.559470 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:38.559437    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 21 13:30:38.559837 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:38.559488    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 21 13:30:39.559364 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:39.559332    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 21 13:30:39.559546 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:39.559399    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 21 13:30:40.559493 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:40.559455    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 21 13:30:40.559687 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:40.559526    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 21 13:30:41.559545 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:41.559510    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 21 13:30:41.559751 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:41.559564    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 21 13:30:42.563334 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:42.563299    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:42.563832 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:42.563684    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:42.564766 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:42.564742    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:30:43.295345 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:43.295303    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 13:30:43.295521 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:43.295367    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 13:30:44.367048 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.366967    2532 generic.go:356] "Generic (PLEG): container finished" podID="27e5dbce-0d41-49ab-a128-64596b407f12" containerID="9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85" exitCode=0
Jul 21 13:30:44.367571 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.367043    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerDied","Data":"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"}
Jul 21 13:30:44.367571 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.367535    2532 scope.go:117] "RemoveContainer" containerID="9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"
Jul 21 13:30:44.368531 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.368505    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:44.368622 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.368567    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:44.368622 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:44.368607    2532 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 13:30:45.378773 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:45.378736    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerStarted","Data":"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"}
Jul 21 13:30:45.590204 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:45.590148    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:45.590415 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:45.590390    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 21 13:30:45.590502 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:45.590463    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 21 13:30:46.589749 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:46.589697    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 21 13:30:46.590312 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:46.589790    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 21 13:30:47.589658 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:47.589611    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 21 13:30:47.589893 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:47.589668    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 21 13:30:48.590511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:48.590472    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 21 13:30:48.591131 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:48.591097    2532 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 21 13:30:49.593377 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:49.593349    2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:49.593849 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:49.593660    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:49.594423 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:49.594405    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:30:55.545308 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:55.545273    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:30:55.549191 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:30:55.549148    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:34:55.780596 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:34:55.780562    2532 scope.go:117] "RemoveContainer" containerID="0acad9ec82b5004dbab76d4c8b00f75f24bda2dfc77b89ba3279de1e9ecc3820"
Jul 21 13:35:55.587094 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:35:55.587063    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:35:55.593978 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:35:55.593949    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:36:14.934323 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.934287    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018200955568"]
Jul 21 13:36:14.934855 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.934688    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:36:14.934855 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.934700    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="8395fa14-7025-4094-a741-a6a3eb1ebd3b" containerName="istio-proxy"
Jul 21 13:36:14.937875 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.937856    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:14.941057 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.941033    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8g4qw\""
Jul 21 13:36:14.946319 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:14.946295    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018200955568"]
Jul 21 13:36:15.013952 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.013917    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzldh\" (UniqueName: \"kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh\") pod \"test-curl-7312-140018200955568\" (UID: \"e6a63ab8-3e30-428a-960b-89206bb22b89\") " pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:15.115398 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.115362    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzldh\" (UniqueName: \"kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh\") pod \"test-curl-7312-140018200955568\" (UID: \"e6a63ab8-3e30-428a-960b-89206bb22b89\") " pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:15.125732 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.125699    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzldh\" (UniqueName: \"kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh\") pod \"test-curl-7312-140018200955568\" (UID: \"e6a63ab8-3e30-428a-960b-89206bb22b89\") " pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:15.248130 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.248103    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:15.398698 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.398675    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018200955568"]
Jul 21 13:36:15.400102 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:15.400079    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6a63ab8_3e30_428a_960b_89206bb22b89.slice/crio-0c8d44522f1c6a2024bc83b8f058b1249fb9e9ef6ed56b28c27214e59f450aad WatchSource:0}: Error finding container 0c8d44522f1c6a2024bc83b8f058b1249fb9e9ef6ed56b28c27214e59f450aad: Status 404 returned error can't find the container with id 0c8d44522f1c6a2024bc83b8f058b1249fb9e9ef6ed56b28c27214e59f450aad
Jul 21 13:36:15.401343 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:15.401325    2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 13:36:16.255107 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:16.255073    2532 generic.go:356] "Generic (PLEG): container finished" podID="e6a63ab8-3e30-428a-960b-89206bb22b89" containerID="67e160d94592da7941c205adf6d47e3c90a0d96274fe837ed657e445aa3fcf8c" exitCode=0
Jul 21 13:36:16.255450 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:16.255181    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018200955568" event={"ID":"e6a63ab8-3e30-428a-960b-89206bb22b89","Type":"ContainerDied","Data":"67e160d94592da7941c205adf6d47e3c90a0d96274fe837ed657e445aa3fcf8c"}
Jul 21 13:36:16.255450 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:16.255232    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018200955568" event={"ID":"e6a63ab8-3e30-428a-960b-89206bb22b89","Type":"ContainerStarted","Data":"0c8d44522f1c6a2024bc83b8f058b1249fb9e9ef6ed56b28c27214e59f450aad"}
Jul 21 13:36:17.397505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.397467    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:17.438021 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.437995    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzldh\" (UniqueName: \"kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh\") pod \"e6a63ab8-3e30-428a-960b-89206bb22b89\" (UID: \"e6a63ab8-3e30-428a-960b-89206bb22b89\") "
Jul 21 13:36:17.439670 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.439646    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018200955568_e6a63ab8-3e30-428a-960b-89206bb22b89/test-curl-7312-140018200955568/0.log"
Jul 21 13:36:17.440505 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.440482    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh" (OuterVolumeSpecName: "kube-api-access-gzldh") pod "e6a63ab8-3e30-428a-960b-89206bb22b89" (UID: "e6a63ab8-3e30-428a-960b-89206bb22b89"). InnerVolumeSpecName "kube-api-access-gzldh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:17.469297 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.469262    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018200955568"]
Jul 21 13:36:17.472806 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.472782    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018200955568"]
Jul 21 13:36:17.538957 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.538875    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzldh\" (UniqueName: \"kubernetes.io/projected/e6a63ab8-3e30-428a-960b-89206bb22b89-kube-api-access-gzldh\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:17.611975 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.611944    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018200983600"]
Jul 21 13:36:17.612412 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.612398    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" containerName="test-curl-7312-140018200955568"
Jul 21 13:36:17.612472 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.612414    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" containerName="test-curl-7312-140018200955568"
Jul 21 13:36:17.612508 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.612482    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" containerName="test-curl-7312-140018200955568"
Jul 21 13:36:17.615482 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.615468    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:17.635807 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.635777    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018200983600"]
Jul 21 13:36:17.740788 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.740750    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t9f\" (UniqueName: \"kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f\") pod \"test-curl-7312-140018200983600\" (UID: \"b3474328-8f02-44c6-8dd4-49e581ce0615\") " pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:17.841667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.841578    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t9f\" (UniqueName: \"kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f\") pod \"test-curl-7312-140018200983600\" (UID: \"b3474328-8f02-44c6-8dd4-49e581ce0615\") " pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:17.853884 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.853853    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t9f\" (UniqueName: \"kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f\") pod \"test-curl-7312-140018200983600\" (UID: \"b3474328-8f02-44c6-8dd4-49e581ce0615\") " pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:17.924289 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:17.924259    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:18.073902 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:18.073877    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018200983600"]
Jul 21 13:36:18.075012 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:18.074986    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3474328_8f02_44c6_8dd4_49e581ce0615.slice/crio-427a98c94e4dea29273bfb3934ba2a34a54f5028d0478af46ce67e0734f15c8c WatchSource:0}: Error finding container 427a98c94e4dea29273bfb3934ba2a34a54f5028d0478af46ce67e0734f15c8c: Status 404 returned error can't find the container with id 427a98c94e4dea29273bfb3934ba2a34a54f5028d0478af46ce67e0734f15c8c
Jul 21 13:36:18.268723 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:18.268680    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018200983600" event={"ID":"b3474328-8f02-44c6-8dd4-49e581ce0615","Type":"ContainerStarted","Data":"427a98c94e4dea29273bfb3934ba2a34a54f5028d0478af46ce67e0734f15c8c"}
Jul 21 13:36:18.269894 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:18.269870    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:18.269998 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:18.269922    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c8d44522f1c6a2024bc83b8f058b1249fb9e9ef6ed56b28c27214e59f450aad"
Jul 21 13:36:18.280690 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:36:18.280665    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7312-140018200955568\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:19.278123 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:19.278090    2532 generic.go:356] "Generic (PLEG): container finished" podID="b3474328-8f02-44c6-8dd4-49e581ce0615" containerID="8ec6661eeea660433b0956e1ad6a73ee33b5e1b2f5f53299eff36a6ba087580a" exitCode=0
Jul 21 13:36:19.278509 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:19.278188    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018200983600" event={"ID":"b3474328-8f02-44c6-8dd4-49e581ce0615","Type":"ContainerDied","Data":"8ec6661eeea660433b0956e1ad6a73ee33b5e1b2f5f53299eff36a6ba087580a"}
Jul 21 13:36:19.302442 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:36:19.302413    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7312-140018200955568\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" pod="opendatahub/test-curl-7312-140018200955568"
Jul 21 13:36:19.359116 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:19.359094    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a63ab8-3e30-428a-960b-89206bb22b89" path="/var/lib/kubelet/pods/e6a63ab8-3e30-428a-960b-89206bb22b89/volumes"
Jul 21 13:36:20.425947 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.425921    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:20.451087 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.450977    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018200983600_b3474328-8f02-44c6-8dd4-49e581ce0615/test-curl-7312-140018200983600/0.log"
Jul 21 13:36:20.476343 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.476314    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018200983600"]
Jul 21 13:36:20.481224 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.481203    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018200983600"]
Jul 21 13:36:20.566995 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.566920    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7t9f\" (UniqueName: \"kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f\") pod \"b3474328-8f02-44c6-8dd4-49e581ce0615\" (UID: \"b3474328-8f02-44c6-8dd4-49e581ce0615\") "
Jul 21 13:36:20.569197 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.569132    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f" (OuterVolumeSpecName: "kube-api-access-c7t9f") pod "b3474328-8f02-44c6-8dd4-49e581ce0615" (UID: "b3474328-8f02-44c6-8dd4-49e581ce0615"). InnerVolumeSpecName "kube-api-access-c7t9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:20.638771 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.638742    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:20.639127 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.639115    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3474328-8f02-44c6-8dd4-49e581ce0615" containerName="test-curl-7312-140018200983600"
Jul 21 13:36:20.639214 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.639128    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3474328-8f02-44c6-8dd4-49e581ce0615" containerName="test-curl-7312-140018200983600"
Jul 21 13:36:20.639264 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.639219    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3474328-8f02-44c6-8dd4-49e581ce0615" containerName="test-curl-7312-140018200983600"
Jul 21 13:36:20.642237 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.642222    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:20.655763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.652083    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:20.668381 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.668355    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7t9f\" (UniqueName: \"kubernetes.io/projected/b3474328-8f02-44c6-8dd4-49e581ce0615-kube-api-access-c7t9f\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:20.769333 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.769295    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7gx\" (UniqueName: \"kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx\") pod \"test-curl-7312-140018201117872\" (UID: \"1447acb5-9560-4bd2-a71e-5bd9caef9823\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:20.870673 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.870562    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7gx\" (UniqueName: \"kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx\") pod \"test-curl-7312-140018201117872\" (UID: \"1447acb5-9560-4bd2-a71e-5bd9caef9823\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:20.881831 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.881794    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7gx\" (UniqueName: \"kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx\") pod \"test-curl-7312-140018201117872\" (UID: \"1447acb5-9560-4bd2-a71e-5bd9caef9823\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:20.959304 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:20.959269    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:21.108913 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:21.108881    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:21.110672 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:21.110645    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1447acb5_9560_4bd2_a71e_5bd9caef9823.slice/crio-d4239ff4d4dcbe9fd77d0bdf9ef868c4c9a9efcc0f9fd8f4539e4095bd8cd5e0 WatchSource:0}: Error finding container d4239ff4d4dcbe9fd77d0bdf9ef868c4c9a9efcc0f9fd8f4539e4095bd8cd5e0: Status 404 returned error can't find the container with id d4239ff4d4dcbe9fd77d0bdf9ef868c4c9a9efcc0f9fd8f4539e4095bd8cd5e0
Jul 21 13:36:21.291233 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:21.291203    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="427a98c94e4dea29273bfb3934ba2a34a54f5028d0478af46ce67e0734f15c8c"
Jul 21 13:36:21.291233 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:21.291234    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:21.292481 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:21.292456    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201117872" event={"ID":"1447acb5-9560-4bd2-a71e-5bd9caef9823","Type":"ContainerStarted","Data":"d4239ff4d4dcbe9fd77d0bdf9ef868c4c9a9efcc0f9fd8f4539e4095bd8cd5e0"}
Jul 21 13:36:21.302509 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:36:21.302482    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7312-140018200983600\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="b3474328-8f02-44c6-8dd4-49e581ce0615" pod="opendatahub/test-curl-7312-140018200983600"
Jul 21 13:36:21.358392 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:21.358359    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3474328-8f02-44c6-8dd4-49e581ce0615" path="/var/lib/kubelet/pods/b3474328-8f02-44c6-8dd4-49e581ce0615/volumes"
Jul 21 13:36:22.299566 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:22.299533    2532 generic.go:356] "Generic (PLEG): container finished" podID="1447acb5-9560-4bd2-a71e-5bd9caef9823" containerID="c7e1c8746fe2a43857455319730d9fd80b0e50334e8a5813125df5b05b970dee" exitCode=0
Jul 21 13:36:22.300054 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:22.299586    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201117872" event={"ID":"1447acb5-9560-4bd2-a71e-5bd9caef9823","Type":"ContainerDied","Data":"c7e1c8746fe2a43857455319730d9fd80b0e50334e8a5813125df5b05b970dee"}
Jul 21 13:36:23.444249 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.444228    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:23.467899 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.467844    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018201117872_1447acb5-9560-4bd2-a71e-5bd9caef9823/test-curl-7312-140018201117872/0.log"
Jul 21 13:36:23.499638 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.499611    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:23.504137 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.504112    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:23.595068 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.594974    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt7gx\" (UniqueName: \"kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx\") pod \"1447acb5-9560-4bd2-a71e-5bd9caef9823\" (UID: \"1447acb5-9560-4bd2-a71e-5bd9caef9823\") "
Jul 21 13:36:23.597294 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.597270    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx" (OuterVolumeSpecName: "kube-api-access-xt7gx") pod "1447acb5-9560-4bd2-a71e-5bd9caef9823" (UID: "1447acb5-9560-4bd2-a71e-5bd9caef9823"). InnerVolumeSpecName "kube-api-access-xt7gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:23.629758 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.629719    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:23.630226 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.630206    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1447acb5-9560-4bd2-a71e-5bd9caef9823" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:23.630320 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.630227    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="1447acb5-9560-4bd2-a71e-5bd9caef9823" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:23.630381 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.630360    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="1447acb5-9560-4bd2-a71e-5bd9caef9823" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:23.633774 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.633754    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:23.643091 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.643068    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:23.696457 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.696423    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59gs\" (UniqueName: \"kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs\") pod \"test-curl-7312-140018201117872\" (UID: \"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:23.696656 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.696593    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt7gx\" (UniqueName: \"kubernetes.io/projected/1447acb5-9560-4bd2-a71e-5bd9caef9823-kube-api-access-xt7gx\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:23.797257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.797220    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59gs\" (UniqueName: \"kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs\") pod \"test-curl-7312-140018201117872\" (UID: \"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:23.808207 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.808179    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59gs\" (UniqueName: \"kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs\") pod \"test-curl-7312-140018201117872\" (UID: \"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce\") " pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:23.943302 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:23.943277    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:24.094868 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:24.094847    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:24.097193 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:24.097136    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode20b8f45_0a4d_4ac2_89b3_f5955ae1d8ce.slice/crio-a7b3f32a6af3d344391b0326286982466358ae9d8edc76c3ce0700a3aa82ca5f WatchSource:0}: Error finding container a7b3f32a6af3d344391b0326286982466358ae9d8edc76c3ce0700a3aa82ca5f: Status 404 returned error can't find the container with id a7b3f32a6af3d344391b0326286982466358ae9d8edc76c3ce0700a3aa82ca5f
Jul 21 13:36:24.313295 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:24.313213    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:24.313295 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:24.313228    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4239ff4d4dcbe9fd77d0bdf9ef868c4c9a9efcc0f9fd8f4539e4095bd8cd5e0"
Jul 21 13:36:24.314561 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:24.314538    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201117872" event={"ID":"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce","Type":"ContainerStarted","Data":"a7b3f32a6af3d344391b0326286982466358ae9d8edc76c3ce0700a3aa82ca5f"}
Jul 21 13:36:24.326791 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:24.326761    2532 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7312-140018201117872" oldPodUID="1447acb5-9560-4bd2-a71e-5bd9caef9823" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce"
Jul 21 13:36:25.321209 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:25.321173    2532 generic.go:356] "Generic (PLEG): container finished" podID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" containerID="1ada87afc22974a5dafdb40faa7a34615f07ccec2a910f5cb69f60776aa07ca2" exitCode=0
Jul 21 13:36:25.321605 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:25.321271    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201117872" event={"ID":"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce","Type":"ContainerDied","Data":"1ada87afc22974a5dafdb40faa7a34615f07ccec2a910f5cb69f60776aa07ca2"}
Jul 21 13:36:25.358591 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:25.358562    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1447acb5-9560-4bd2-a71e-5bd9caef9823" path="/var/lib/kubelet/pods/1447acb5-9560-4bd2-a71e-5bd9caef9823/volumes"
Jul 21 13:36:26.469220 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.469192    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:26.494112 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.494085    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018201117872_e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce/test-curl-7312-140018201117872/0.log"
Jul 21 13:36:26.521809 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.521781    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:26.529553 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.529532    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018201117872"]
Jul 21 13:36:26.618285 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.618208    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g59gs\" (UniqueName: \"kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs\") pod \"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce\" (UID: \"e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce\") "
Jul 21 13:36:26.620386 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.620364    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs" (OuterVolumeSpecName: "kube-api-access-g59gs") pod "e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" (UID: "e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce"). InnerVolumeSpecName "kube-api-access-g59gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:26.660076 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.660054    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:26.660480 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.660466    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:26.660525 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.660481    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:26.660557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.660544    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" containerName="test-curl-7312-140018201117872"
Jul 21 13:36:26.663615 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.663597    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:26.675556 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.675530    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:26.719570 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.719550    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g59gs\" (UniqueName: \"kubernetes.io/projected/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce-kube-api-access-g59gs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:26.820218 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.820193    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fxh\" (UniqueName: \"kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh\") pod \"test-curl-7312-140018201118880\" (UID: \"c51c240a-fe0b-48c3-9709-432e109ee348\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:26.921038 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.920966    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fxh\" (UniqueName: \"kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh\") pod \"test-curl-7312-140018201118880\" (UID: \"c51c240a-fe0b-48c3-9709-432e109ee348\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:26.931412 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.931386    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fxh\" (UniqueName: \"kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh\") pod \"test-curl-7312-140018201118880\" (UID: \"c51c240a-fe0b-48c3-9709-432e109ee348\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:26.976082 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:26.976059    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:27.109934 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:27.109909    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:27.110969 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:27.110951    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc51c240a_fe0b_48c3_9709_432e109ee348.slice/crio-7713d5f0bb653f8d982f8bef22eb74e27dbdf34240345ca09b88a1208e7b7022 WatchSource:0}: Error finding container 7713d5f0bb653f8d982f8bef22eb74e27dbdf34240345ca09b88a1208e7b7022: Status 404 returned error can't find the container with id 7713d5f0bb653f8d982f8bef22eb74e27dbdf34240345ca09b88a1208e7b7022
Jul 21 13:36:27.335319 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:27.335286    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201118880" event={"ID":"c51c240a-fe0b-48c3-9709-432e109ee348","Type":"ContainerStarted","Data":"7713d5f0bb653f8d982f8bef22eb74e27dbdf34240345ca09b88a1208e7b7022"}
Jul 21 13:36:27.336419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:27.336398    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:27.336419 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:27.336418    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b3f32a6af3d344391b0326286982466358ae9d8edc76c3ce0700a3aa82ca5f"
Jul 21 13:36:27.347186 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:36:27.347147    2532 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7312-140018201117872\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" pod="opendatahub/test-curl-7312-140018201117872"
Jul 21 13:36:27.357953 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:27.357934    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce" path="/var/lib/kubelet/pods/e20b8f45-0a4d-4ac2-89b3-f5955ae1d8ce/volumes"
Jul 21 13:36:28.343781 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:28.343743    2532 generic.go:356] "Generic (PLEG): container finished" podID="c51c240a-fe0b-48c3-9709-432e109ee348" containerID="58e6ea84577f93d9c124d4aba9fc6f9bd891471bd34c43dabfdc74d4bbecbe89" exitCode=0
Jul 21 13:36:28.344186 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:28.343809    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201118880" event={"ID":"c51c240a-fe0b-48c3-9709-432e109ee348","Type":"ContainerDied","Data":"58e6ea84577f93d9c124d4aba9fc6f9bd891471bd34c43dabfdc74d4bbecbe89"}
Jul 21 13:36:29.491411 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.491385    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:29.518603 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.518575    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018201118880_c51c240a-fe0b-48c3-9709-432e109ee348/test-curl-7312-140018201118880/0.log"
Jul 21 13:36:29.557191 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.557146    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:29.562796 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.562775    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:29.644569 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.644494    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9fxh\" (UniqueName: \"kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh\") pod \"c51c240a-fe0b-48c3-9709-432e109ee348\" (UID: \"c51c240a-fe0b-48c3-9709-432e109ee348\") "
Jul 21 13:36:29.646651 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.646625    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh" (OuterVolumeSpecName: "kube-api-access-d9fxh") pod "c51c240a-fe0b-48c3-9709-432e109ee348" (UID: "c51c240a-fe0b-48c3-9709-432e109ee348"). InnerVolumeSpecName "kube-api-access-d9fxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:29.695982 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.695948    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:29.696385 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.696372    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51c240a-fe0b-48c3-9709-432e109ee348" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:29.696435 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.696387    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51c240a-fe0b-48c3-9709-432e109ee348" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:29.696473 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.696465    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51c240a-fe0b-48c3-9709-432e109ee348" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:29.699571 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.699556    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:29.710815 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.710790    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:29.745849 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.745826    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9fxh\" (UniqueName: \"kubernetes.io/projected/c51c240a-fe0b-48c3-9709-432e109ee348-kube-api-access-d9fxh\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:29.846459 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.846426    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfds9\" (UniqueName: \"kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9\") pod \"test-curl-7312-140018201118880\" (UID: \"c6e16b68-e348-42a6-a40f-d6dde15e0c56\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:29.947389 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.947358    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfds9\" (UniqueName: \"kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9\") pod \"test-curl-7312-140018201118880\" (UID: \"c6e16b68-e348-42a6-a40f-d6dde15e0c56\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:29.958259 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:29.958232    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfds9\" (UniqueName: \"kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9\") pod \"test-curl-7312-140018201118880\" (UID: \"c6e16b68-e348-42a6-a40f-d6dde15e0c56\") " pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:30.009274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.009241    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:30.160131 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.160084    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:30.162882 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:30.162842    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6e16b68_e348_42a6_a40f_d6dde15e0c56.slice/crio-27025f1e4ac6d60b08fc35906d74c49f89e1c691b7b003ca98e6eabe0da64cc7 WatchSource:0}: Error finding container 27025f1e4ac6d60b08fc35906d74c49f89e1c691b7b003ca98e6eabe0da64cc7: Status 404 returned error can't find the container with id 27025f1e4ac6d60b08fc35906d74c49f89e1c691b7b003ca98e6eabe0da64cc7
Jul 21 13:36:30.356779 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.356691    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:30.356779 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.356728    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7713d5f0bb653f8d982f8bef22eb74e27dbdf34240345ca09b88a1208e7b7022"
Jul 21 13:36:30.357989 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.357963    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201118880" event={"ID":"c6e16b68-e348-42a6-a40f-d6dde15e0c56","Type":"ContainerStarted","Data":"27025f1e4ac6d60b08fc35906d74c49f89e1c691b7b003ca98e6eabe0da64cc7"}
Jul 21 13:36:30.370023 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:30.369997    2532 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7312-140018201118880" oldPodUID="c51c240a-fe0b-48c3-9709-432e109ee348" podUID="c6e16b68-e348-42a6-a40f-d6dde15e0c56"
Jul 21 13:36:31.359692 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:31.359665    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51c240a-fe0b-48c3-9709-432e109ee348" path="/var/lib/kubelet/pods/c51c240a-fe0b-48c3-9709-432e109ee348/volumes"
Jul 21 13:36:31.366387 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:31.366360    2532 generic.go:356] "Generic (PLEG): container finished" podID="c6e16b68-e348-42a6-a40f-d6dde15e0c56" containerID="3c2f370be7baa82c275b49352b4eea9237c3cc450c853514079f94fb88bc3681" exitCode=0
Jul 21 13:36:31.366525 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:31.366444    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7312-140018201118880" event={"ID":"c6e16b68-e348-42a6-a40f-d6dde15e0c56","Type":"ContainerDied","Data":"3c2f370be7baa82c275b49352b4eea9237c3cc450c853514079f94fb88bc3681"}
Jul 21 13:36:32.513741 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.513718    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:32.535088 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.534988    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7312-140018201118880_c6e16b68-e348-42a6-a40f-d6dde15e0c56/test-curl-7312-140018201118880/0.log"
Jul 21 13:36:32.559080 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.559037    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:32.565064 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.565040    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7312-140018201118880"]
Jul 21 13:36:32.673123 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.673049    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfds9\" (UniqueName: \"kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9\") pod \"c6e16b68-e348-42a6-a40f-d6dde15e0c56\" (UID: \"c6e16b68-e348-42a6-a40f-d6dde15e0c56\") "
Jul 21 13:36:32.675267 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.675247    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9" (OuterVolumeSpecName: "kube-api-access-hfds9") pod "c6e16b68-e348-42a6-a40f-d6dde15e0c56" (UID: "c6e16b68-e348-42a6-a40f-d6dde15e0c56"). InnerVolumeSpecName "kube-api-access-hfds9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:36:32.748362 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.748325    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"]
Jul 21 13:36:32.748928 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.748909    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e16b68-e348-42a6-a40f-d6dde15e0c56" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:32.748967 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.748934    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e16b68-e348-42a6-a40f-d6dde15e0c56" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:32.749067 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.749056    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e16b68-e348-42a6-a40f-d6dde15e0c56" containerName="test-curl-7312-140018201118880"
Jul 21 13:36:32.752542 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.752527    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:32.756111 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.756087    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhp7l\""
Jul 21 13:36:32.759900 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.759472    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"]
Jul 21 13:36:32.773687 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.773665    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfds9\" (UniqueName: \"kubernetes.io/projected/c6e16b68-e348-42a6-a40f-d6dde15e0c56-kube-api-access-hfds9\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:32.874536 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.874500    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd\" (UID: \"f69eadcd-b769-4c7a-b0f5-575761cb128b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:32.975988 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.975952    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd\" (UID: \"f69eadcd-b769-4c7a-b0f5-575761cb128b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:32.976569 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:32.976536    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd\" (UID: \"f69eadcd-b769-4c7a-b0f5-575761cb128b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:33.067490 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.067453    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:33.204005 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.203980    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"]
Jul 21 13:36:33.205971 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:36:33.205947    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69eadcd_b769_4c7a_b0f5_575761cb128b.slice/crio-834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb WatchSource:0}: Error finding container 834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb: Status 404 returned error can't find the container with id 834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb
Jul 21 13:36:33.358491 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.358455    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e16b68-e348-42a6-a40f-d6dde15e0c56" path="/var/lib/kubelet/pods/c6e16b68-e348-42a6-a40f-d6dde15e0c56/volumes"
Jul 21 13:36:33.380997 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.380972    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7312-140018201118880"
Jul 21 13:36:33.381110 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.381019    2532 scope.go:117] "RemoveContainer" containerID="3c2f370be7baa82c275b49352b4eea9237c3cc450c853514079f94fb88bc3681"
Jul 21 13:36:33.382523 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:33.382494    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd" event={"ID":"f69eadcd-b769-4c7a-b0f5-575761cb128b","Type":"ContainerStarted","Data":"834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb"}
Jul 21 13:36:34.396804 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:34.396773    2532 generic.go:356] "Generic (PLEG): container finished" podID="f69eadcd-b769-4c7a-b0f5-575761cb128b" containerID="532e135f5c450701adf45eaa95d6d096fc393b98bc23c6e102f8464ce46fa4f5" exitCode=0
Jul 21 13:36:34.397290 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:34.396847    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd" event={"ID":"f69eadcd-b769-4c7a-b0f5-575761cb128b","Type":"ContainerDied","Data":"532e135f5c450701adf45eaa95d6d096fc393b98bc23c6e102f8464ce46fa4f5"}
Jul 21 13:36:35.540076 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:35.540053    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:35.698453 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:35.698421    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca\") pod \"f69eadcd-b769-4c7a-b0f5-575761cb128b\" (UID: \"f69eadcd-b769-4c7a-b0f5-575761cb128b\") "
Jul 21 13:36:35.698773 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:35.698750    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f69eadcd-b769-4c7a-b0f5-575761cb128b" (UID: "f69eadcd-b769-4c7a-b0f5-575761cb128b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:36:35.799031 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:35.799000    2532 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69eadcd-b769-4c7a-b0f5-575761cb128b-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:36:36.408511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:36.408483    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"
Jul 21 13:36:36.408511 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:36.408492    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd" event={"ID":"f69eadcd-b769-4c7a-b0f5-575761cb128b","Type":"ContainerDied","Data":"834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb"}
Jul 21 13:36:36.408804 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:36.408535    2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="834a4c72ec3bc71c199e195a4cda20192dd03a7e190f2e70d435dc41d21a14bb"
Jul 21 13:36:47.843057 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:47.843013    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"]
Jul 21 13:36:47.846240 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:47.846218    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af280-tkfsd"]
Jul 21 13:36:49.358233 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:49.358203    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69eadcd-b769-4c7a-b0f5-575761cb128b" path="/var/lib/kubelet/pods/f69eadcd-b769-4c7a-b0f5-575761cb128b/volumes"
Jul 21 13:36:54.822958 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:54.822921    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:36:54.823814 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:54.823761    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" containerID="cri-o://bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36" gracePeriod=30
Jul 21 13:36:57.566232 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:57.566193    2532 patch_prober.go:28] interesting pod/e2e-shared-a-3af280-openshift-default-867bff9667-892xg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 13:36:57.566707 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:36:57.566257    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 13:37:00.091101 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.091028    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:37:00.204120 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204091    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204136    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204191    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204206    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204253    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvr7l\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204270    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204342 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204325    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204665 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204451    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204665 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204483    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:00.204665 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204498    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert\") pod \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\" (UID: \"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e\") "
Jul 21 13:37:00.204665 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204509    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:00.204889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204740    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.204889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204758    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.204889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204842    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:00.204889 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204867    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:37:00.205109 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.204919    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:00.206651 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.206623    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l" (OuterVolumeSpecName: "kube-api-access-dvr7l") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "kube-api-access-dvr7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:37:00.206895 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.206864    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:37:00.207181 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.207139    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:37:00.207263 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.207186    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" (UID: "bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:00.306000 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.305962    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306000 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.305994    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvr7l\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-kube-api-access-dvr7l\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306000 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.306008    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.306022    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.306044    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.306054    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.306277 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.306065    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:00.551935 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.551900    2532 generic.go:356] "Generic (PLEG): container finished" podID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerID="bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36" exitCode=0
Jul 21 13:37:00.552121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.551949    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"
Jul 21 13:37:00.552121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.551987    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerDied","Data":"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"}
Jul 21 13:37:00.552121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.552036    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg" event={"ID":"bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e","Type":"ContainerDied","Data":"3f36342214fabd7cac9db28084b61c4fe535133db89cc102f261ab6b1ba151e5"}
Jul 21 13:37:00.552121 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.552058    2532 scope.go:117] "RemoveContainer" containerID="bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"
Jul 21 13:37:00.562120 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.562105    2532 scope.go:117] "RemoveContainer" containerID="b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"
Jul 21 13:37:00.570667 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.570652    2532 scope.go:117] "RemoveContainer" containerID="bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"
Jul 21 13:37:00.570916 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:37:00.570899    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36\": container with ID starting with bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36 not found: ID does not exist" containerID="bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"
Jul 21 13:37:00.570954 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.570924    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36"} err="failed to get container status \"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36\": rpc error: code = NotFound desc = could not find container \"bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36\": container with ID starting with bc1831453ea5f28bd8a206a22e77ecf326551305c5ce6d537c04fc36b7d30b36 not found: ID does not exist"
Jul 21 13:37:00.570954 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.570941    2532 scope.go:117] "RemoveContainer" containerID="b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"
Jul 21 13:37:00.571209 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:37:00.571193    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0\": container with ID starting with b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0 not found: ID does not exist" containerID="b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"
Jul 21 13:37:00.571252 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.571216    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0"} err="failed to get container status \"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0\": rpc error: code = NotFound desc = could not find container \"b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0\": container with ID starting with b2ab4dc37b4040089d3aeefb2dabd643a683711848133c6411b459bcda88c7d0 not found: ID does not exist"
Jul 21 13:37:00.576247 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.576216    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:37:00.580926 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:00.580904    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3af280-openshift-default-867bff9667-892xg"]
Jul 21 13:37:01.358030 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:01.357997    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" path="/var/lib/kubelet/pods/bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e/volumes"
Jul 21 13:37:17.053135 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:17.053051    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:37:17.053575 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:17.053287    2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" containerID="cri-o://8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73" gracePeriod=30
Jul 21 13:37:17.716202 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:17.716143    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f6f8d8d6-gllrp_63d29853-9fe4-4f58-925c-bcaea23f2b8c/authorino/0.log"
Jul 21 13:37:19.596055 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:19.596023    2532 patch_prober.go:28] interesting pod/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 13:37:19.596564 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:19.596092    2532 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 13:37:22.325305 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.325248    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:37:22.519375 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519340    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519387    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519405    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxc5m\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519557 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519438    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519666 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519616    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519666 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519648    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519753 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519675    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:22.519831 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519806    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.519932 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519903    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:22.519932 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519914    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.520148 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.519978    2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert\") pod \"27e5dbce-0d41-49ab-a128-64596b407f12\" (UID: \"27e5dbce-0d41-49ab-a128-64596b407f12\") "
Jul 21 13:37:22.520148 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520048    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:22.520471 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520409    2532 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.520471 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520429    2532 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-workload-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.520471 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520443    2532 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-credential-socket\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.520471 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520465    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 13:37:22.520958 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.520896    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data" (OuterVolumeSpecName: "istio-data") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:22.521940 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.521919    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m" (OuterVolumeSpecName: "kube-api-access-hxc5m") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "kube-api-access-hxc5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:37:22.522037 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.521958    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token" (OuterVolumeSpecName: "istio-token") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 13:37:22.522143 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.522121    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 13:37:22.522288 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.522266    2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27e5dbce-0d41-49ab-a128-64596b407f12" (UID: "27e5dbce-0d41-49ab-a128-64596b407f12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621443    2532 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-data\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621468    2532 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e5dbce-0d41-49ab-a128-64596b407f12-istiod-ca-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621478    2532 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e5dbce-0d41-49ab-a128-64596b407f12-istio-podinfo\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621486    2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxc5m\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-kube-api-access-hxc5m\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621496    2532 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e5dbce-0d41-49ab-a128-64596b407f12-istio-envoy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.621528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.621504    2532 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e5dbce-0d41-49ab-a128-64596b407f12-istio-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 21 13:37:22.682670 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.682642    2532 generic.go:356] "Generic (PLEG): container finished" podID="27e5dbce-0d41-49ab-a128-64596b407f12" containerID="8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73" exitCode=0
Jul 21 13:37:22.682848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.682706    2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"
Jul 21 13:37:22.682848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.682732    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerDied","Data":"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"}
Jul 21 13:37:22.682848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.682788    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6" event={"ID":"27e5dbce-0d41-49ab-a128-64596b407f12","Type":"ContainerDied","Data":"2a530478a5317580906a1752bde3d363e071230faf2e25db8c8d93db2d1b29c7"}
Jul 21 13:37:22.682848 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.682812    2532 scope.go:117] "RemoveContainer" containerID="8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"
Jul 21 13:37:22.692522 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.692507    2532 scope.go:117] "RemoveContainer" containerID="9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"
Jul 21 13:37:22.700763 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.700747    2532 scope.go:117] "RemoveContainer" containerID="8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"
Jul 21 13:37:22.700997 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:37:22.700982    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73\": container with ID starting with 8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73 not found: ID does not exist" containerID="8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"
Jul 21 13:37:22.701039 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.701004    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73"} err="failed to get container status \"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73\": rpc error: code = NotFound desc = could not find container \"8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73\": container with ID starting with 8db40de20d9e90d4bc7df5b100b0e1ffcb1d193c3ad71803577230ae9df79b73 not found: ID does not exist"
Jul 21 13:37:22.701039 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.701018    2532 scope.go:117] "RemoveContainer" containerID="9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"
Jul 21 13:37:22.701243 ip-10-0-140-67 kubenswrapper[2532]: E0721 13:37:22.701219    2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85\": container with ID starting with 9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85 not found: ID does not exist" containerID="9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"
Jul 21 13:37:22.701311 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.701252    2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85"} err="failed to get container status \"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85\": rpc error: code = NotFound desc = could not find container \"9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85\": container with ID starting with 9e4933550c4f1e8ec4ac2195f38586cebf81225dec74f60b9b0645f593027d85 not found: ID does not exist"
Jul 21 13:37:22.705430 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.705409    2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:37:22.709047 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.709028    2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2df168-openshift-default-5d5c6b66f9-ptqd6"]
Jul 21 13:37:22.925585 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:22.925481    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jvqfx_1ac4a49e-0d29-4930-a7c4-884b8c1ae105/manager/0.log"
Jul 21 13:37:23.043540 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.043490    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4jg8r_0e66d7f5-048d-4928-8dce-2b705fe40f85/manager/0.log"
Jul 21 13:37:23.164190 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.164135    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-688696d74-k6bs8_5c548be2-4f91-4c35-bce1-7782151ea23f/manager/0.log"
Jul 21 13:37:23.272321 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.272288    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wvvgw_8d64da43-7f6b-464e-8023-755c46865eaa/server/0.log"
Jul 21 13:37:23.358528 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.358499    2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" path="/var/lib/kubelet/pods/27e5dbce-0d41-49ab-a128-64596b407f12/volumes"
Jul 21 13:37:23.398686 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.398656    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qmqff_d142ea37-b32e-4261-a6fb-22edae766894/manager/0.log"
Jul 21 13:37:23.630740 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.630666    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-rms67_4780c830-e1ff-4477-bb11-c83ef287d343/copy-manifests/0.log"
Jul 21 13:37:23.637662 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:23.637643    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-rms67_4780c830-e1ff-4477-bb11-c83ef287d343/manager/0.log"
Jul 21 13:37:24.110297 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:24.110264    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-594665875c-p9hq8_50f855bf-2666-436c-a1f6-840bf22c0484/maas-api/0.log"
Jul 21 13:37:24.216847 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:24.216821    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743980-hphtb_f4bf81e0-43cc-4238-bfec-b9a96da01f15/cleanup/0.log"
Jul 21 13:37:24.321809 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:24.321780    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743995-g6rwk_bc51f7b5-8be3-43a1-8c85-033c5e6f1094/cleanup/0.log"
Jul 21 13:37:24.524885 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:24.524852    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mr48d_9eb18456-eed9-4f5e-b797-1252e50f75ca/postgres/0.log"
Jul 21 13:37:25.269063 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.269027    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/util/0.log"
Jul 21 13:37:25.275075 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.275046    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/pull/0.log"
Jul 21 13:37:25.281423 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.281390    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/extract/0.log"
Jul 21 13:37:25.387915 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.387885    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/pull/0.log"
Jul 21 13:37:25.393358 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.393329    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/extract/0.log"
Jul 21 13:37:25.398596 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.398577    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/util/0.log"
Jul 21 13:37:25.510218 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.510192    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/util/0.log"
Jul 21 13:37:25.516613 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.516592    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/pull/0.log"
Jul 21 13:37:25.522671 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.522612    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/extract/0.log"
Jul 21 13:37:25.626279 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.626252    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/extract/0.log"
Jul 21 13:37:25.631969 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.631948    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/util/0.log"
Jul 21 13:37:25.637543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.637524    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/pull/0.log"
Jul 21 13:37:25.753701 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.753673    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f6f8d8d6-gllrp_63d29853-9fe4-4f58-925c-bcaea23f2b8c/authorino/0.log"
Jul 21 13:37:25.868916 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:25.868823    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6rzz4_664ad3f1-b529-4f38-b50b-e5ad2e4f32f6/manager/0.log"
Jul 21 13:37:26.214728 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:26.214698    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qhj8k_36c1efc6-10cd-44c6-8cb8-df8239977d86/registry-server/0.log"
Jul 21 13:37:26.338858 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:26.338831    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mqfzv_42a26039-ca0e-4fbd-84b9-19b7c579465e/manager/0.log"
Jul 21 13:37:26.560496 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:26.560427    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxhxv_f0a73de6-1040-4a73-aef8-72a116a2ede6/manager/0.log"
Jul 21 13:37:27.233904 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:27.233877    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-gc2hv_6f0b535a-395d-437b-90eb-48452adf85d2/kube-auth-proxy/0.log"
Jul 21 13:37:27.468687 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:27.468651    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zspzq_54914c2e-4bb9-4317-bf24-2a3a401ad507/payload-pre-processing/0.log"
Jul 21 13:37:28.019083 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:28.019049    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-96x5t_564ff6bd-62c7-4527-a5ac-5600d13fb45c/main/0.log"
Jul 21 13:37:34.501583 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501553    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m5mj/must-gather-mj6nc"]
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501907    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501918    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501926    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69eadcd-b769-4c7a-b0f5-575761cb128b" containerName="revoke-keys"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501931    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69eadcd-b769-4c7a-b0f5-575761cb128b" containerName="revoke-keys"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501938    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501944    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501952    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501957    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501973    2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.501991 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.501978    2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.502354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.502030    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.502354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.502038    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.502354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.502048    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69eadcd-b769-4c7a-b0f5-575761cb128b" containerName="revoke-keys"
Jul 21 13:37:34.502354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.502193    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae8c800-fd2c-4170-a9c7-ee7d8b8a5d4e" containerName="istio-proxy"
Jul 21 13:37:34.502354 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.502200    2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e5dbce-0d41-49ab-a128-64596b407f12" containerName="istio-proxy"
Jul 21 13:37:34.505208 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.505192    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.508696 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.508675    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m5mj\"/\"kube-root-ca.crt\""
Jul 21 13:37:34.509189 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.509172    2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4m5mj\"/\"default-dockercfg-565cz\""
Jul 21 13:37:34.510051 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.510037    2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m5mj\"/\"openshift-service-ca.crt\""
Jul 21 13:37:34.520532 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.520512    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/must-gather-mj6nc"]
Jul 21 13:37:34.523404 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.523382    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw4mg\" (UniqueName: \"kubernetes.io/projected/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-kube-api-access-tw4mg\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.523523 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.523434    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-must-gather-output\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.623830 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.623798    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-must-gather-output\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.623980 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.623874    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw4mg\" (UniqueName: \"kubernetes.io/projected/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-kube-api-access-tw4mg\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.624120 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.624101    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-must-gather-output\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.635512 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.635484    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw4mg\" (UniqueName: \"kubernetes.io/projected/1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871-kube-api-access-tw4mg\") pod \"must-gather-mj6nc\" (UID: \"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871\") " pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.814347 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.814264    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/must-gather-mj6nc"
Jul 21 13:37:34.955869 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:34.955845    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/must-gather-mj6nc"]
Jul 21 13:37:34.957481 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:37:34.957452    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0aaf9b_84fa_45bd_b3fe_e7da7ab56871.slice/crio-1b49581449186d1139c4b506aba6f4f4e4aca81d22472a01428115b397b05b0e WatchSource:0}: Error finding container 1b49581449186d1139c4b506aba6f4f4e4aca81d22472a01428115b397b05b0e: Status 404 returned error can't find the container with id 1b49581449186d1139c4b506aba6f4f4e4aca81d22472a01428115b397b05b0e
Jul 21 13:37:35.760434 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:35.760389    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/must-gather-mj6nc" event={"ID":"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871","Type":"ContainerStarted","Data":"1b49581449186d1139c4b506aba6f4f4e4aca81d22472a01428115b397b05b0e"}
Jul 21 13:37:36.770321 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:36.770285    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/must-gather-mj6nc" event={"ID":"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871","Type":"ContainerStarted","Data":"348b8d8f2fb038db10801f3c283b98cb4fabd84b5c77fd6060f9e954a4a23a91"}
Jul 21 13:37:36.770710 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:36.770331    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/must-gather-mj6nc" event={"ID":"1f0aaf9b-84fa-45bd-b3fe-e7da7ab56871","Type":"ContainerStarted","Data":"058081a3ff5520ea1e7578d51d27951a2ca099a2c8cb2348c70e7a6f7d919952"}
Jul 21 13:37:36.791174 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:36.791093    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m5mj/must-gather-mj6nc" podStartSLOduration=1.940392264 podStartE2EDuration="2.791077388s" totalImagesPullingTime="850.685124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 13:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:37:36.790057038 +0000 UTC m=+2801.827087113" watchObservedRunningTime="2026-07-21 13:37:36.791077388 +0000 UTC m=+2801.828107461"
Jul 21 13:37:37.479876 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:37.479842    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bbcq5_3d23a16c-adef-4f60-b149-7f12f376512a/global-pull-secret-syncer/0.log"
Jul 21 13:37:37.665640 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:37.665599    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pk8hq_98c547cd-1c99-4495-b5e8-d191213e8bd2/konnectivity-agent/0.log"
Jul 21 13:37:37.819676 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:37.819569    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-67.ec2.internal_e182664070bedbec9b679d532069a9ca/haproxy/0.log"
Jul 21 13:37:42.017715 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.017679    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/extract/0.log"
Jul 21 13:37:42.050738 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.050707    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/util/0.log"
Jul 21 13:37:42.076433 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.076404    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sfp9_2ba582e5-cd44-44fe-a543-a0e158f7d4ba/pull/0.log"
Jul 21 13:37:42.110861 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.110826    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/extract/0.log"
Jul 21 13:37:42.141567 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.141539    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/util/0.log"
Jul 21 13:37:42.169770 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.169718    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0775xh_ba01c881-2a9e-4750-8ff7-169d584c2dd2/pull/0.log"
Jul 21 13:37:42.214055 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.214029    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/extract/0.log"
Jul 21 13:37:42.238543 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.238518    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/util/0.log"
Jul 21 13:37:42.266599 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.266574    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlplw_d819326a-29dd-4b6c-9fa0-0a5fda09580f/pull/0.log"
Jul 21 13:37:42.298820 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.298718    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/extract/0.log"
Jul 21 13:37:42.324049 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.324018    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/util/0.log"
Jul 21 13:37:42.348322 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.348290    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljvj8_3f53bb52-4faa-4d23-8958-e65ad2411bff/pull/0.log"
Jul 21 13:37:42.849176 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.848447    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f6f8d8d6-gllrp_63d29853-9fe4-4f58-925c-bcaea23f2b8c/authorino/0.log"
Jul 21 13:37:42.907014 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:42.906981    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6rzz4_664ad3f1-b529-4f38-b50b-e5ad2e4f32f6/manager/0.log"
Jul 21 13:37:43.028226 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:43.028193    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qhj8k_36c1efc6-10cd-44c6-8cb8-df8239977d86/registry-server/0.log"
Jul 21 13:37:43.283175 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:43.282641    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mqfzv_42a26039-ca0e-4fbd-84b9-19b7c579465e/manager/0.log"
Jul 21 13:37:43.412177 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:43.411519    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxhxv_f0a73de6-1040-4a73-aef8-72a116a2ede6/manager/0.log"
Jul 21 13:37:45.909709 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:45.909671    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xq7wk_5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6/node-exporter/0.log"
Jul 21 13:37:45.938032 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:45.937967    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xq7wk_5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6/kube-rbac-proxy/0.log"
Jul 21 13:37:45.964496 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:45.964467    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xq7wk_5058d464-fd5d-4e9f-8b0e-3cec0ab3f9d6/init-textfile/0.log"
Jul 21 13:37:47.717217 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.717181    2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"]
Jul 21 13:37:47.725336 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.725309    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.740431 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.740399    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"]
Jul 21 13:37:47.879745 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.879710    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-lib-modules\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.880066 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.880043    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtz2n\" (UniqueName: \"kubernetes.io/projected/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-kube-api-access-vtz2n\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.880257 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.880239    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-proc\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.880413 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.880398    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-sys\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.880533 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.880519    2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-podres\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982007 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.981932    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtz2n\" (UniqueName: \"kubernetes.io/projected/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-kube-api-access-vtz2n\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982007 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.981992    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-proc\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982039    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-sys\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982060    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-podres\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982099    2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-lib-modules\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982129    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-proc\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982166    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-sys\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982274 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982268    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-lib-modules\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.982490 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.982274    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-podres\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:47.996946 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:47.996921    2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtz2n\" (UniqueName: \"kubernetes.io/projected/4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20-kube-api-access-vtz2n\") pod \"perf-node-gather-daemonset-jqccp\" (UID: \"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20\") " pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:48.038780 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.038748    2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:48.236638 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.236612    2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"]
Jul 21 13:37:48.238707 ip-10-0-140-67 kubenswrapper[2532]: W0721 13:37:48.238674    2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cdf9e22_bdbb_4f21_b4cd_bf3d2da26c20.slice/crio-e80e7d881cc35b3f6819ddf675215694f07d9c25983c6af19b6cb22c91b61e73 WatchSource:0}: Error finding container e80e7d881cc35b3f6819ddf675215694f07d9c25983c6af19b6cb22c91b61e73: Status 404 returned error can't find the container with id e80e7d881cc35b3f6819ddf675215694f07d9c25983c6af19b6cb22c91b61e73
Jul 21 13:37:48.457359 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.457331    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/1.log"
Jul 21 13:37:48.467389 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.467366    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-chwf8_dc49707d-38d8-4c58-8c98-b65975756230/console-operator/2.log"
Jul 21 13:37:48.884826 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.884776    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp" event={"ID":"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20","Type":"ContainerStarted","Data":"89e84f522da8c4574c7228ee6f9f8700dc8a020498c133f5ec1e8bd76a8aaedf"}
Jul 21 13:37:48.885349 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.884890    2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp" event={"ID":"4cdf9e22-bdbb-4f21-b4cd-bf3d2da26c20","Type":"ContainerStarted","Data":"e80e7d881cc35b3f6819ddf675215694f07d9c25983c6af19b6cb22c91b61e73"}
Jul 21 13:37:48.885349 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.885212    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:48.911922 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:48.911846    2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp" podStartSLOduration=1.911823943 podStartE2EDuration="1.911823943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 13:37:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 13:37:48.909232013 +0000 UTC m=+2813.946262082" watchObservedRunningTime="2026-07-21 13:37:48.911823943 +0000 UTC m=+2813.948854018"
Jul 21 13:37:49.718316 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:49.718288    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-9nkjz_c6da096e-eaf1-43d8-b034-322c491b5af7/volume-data-source-validator/0.log"
Jul 21 13:37:51.078174 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:51.078125    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqsdz_fff55b44-4976-4333-bb89-9a157e59dbd8/dns/0.log"
Jul 21 13:37:51.112729 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:51.112695    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqsdz_fff55b44-4976-4333-bb89-9a157e59dbd8/kube-rbac-proxy/0.log"
Jul 21 13:37:51.255625 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:51.255596    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfzld_a5840726-f0a2-417d-912c-ffd43de49f34/dns-node-resolver/0.log"
Jul 21 13:37:51.972534 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:51.972501    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pdg7_9db14508-9239-4159-b728-f007e86e54ef/node-ca/0.log"
Jul 21 13:37:53.462431 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:53.462362    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-gc2hv_6f0b535a-395d-437b-90eb-48452adf85d2/kube-auth-proxy/0.log"
Jul 21 13:37:53.574915 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:53.574884    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zspzq_54914c2e-4bb9-4317-bf24-2a3a401ad507/payload-pre-processing/0.log"
Jul 21 13:37:54.592947 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:54.592920    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzwps_cec5939d-0f1d-4813-8b9d-aad704d988ed/serve-healthcheck-canary/0.log"
Jul 21 13:37:54.904698 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:54.904615    2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4m5mj/perf-node-gather-daemonset-jqccp"
Jul 21 13:37:55.217908 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:55.217878    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wsv9_dd1e2282-8f1e-4712-af97-76e60a5cc93f/kube-rbac-proxy/0.log"
Jul 21 13:37:55.256456 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:55.256427    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wsv9_dd1e2282-8f1e-4712-af97-76e60a5cc93f/exporter/0.log"
Jul 21 13:37:55.297406 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:55.297374    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wsv9_dd1e2282-8f1e-4712-af97-76e60a5cc93f/extractor/0.log"
Jul 21 13:37:58.226821 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.226798    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-gc2hv_6f0b535a-395d-437b-90eb-48452adf85d2/kube-auth-proxy/0.log"
Jul 21 13:37:58.261199 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.261168    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jvqfx_1ac4a49e-0d29-4930-a7c4-884b8c1ae105/manager/0.log"
Jul 21 13:37:58.307148 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.307079    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zspzq_54914c2e-4bb9-4317-bf24-2a3a401ad507/payload-pre-processing/0.log"
Jul 21 13:37:58.579263 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.579179    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4jg8r_0e66d7f5-048d-4928-8dce-2b705fe40f85/manager/0.log"
Jul 21 13:37:58.773678 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.773644    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-688696d74-k6bs8_5c548be2-4f91-4c35-bce1-7782151ea23f/manager/0.log"
Jul 21 13:37:58.801309 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.801286    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wvvgw_8d64da43-7f6b-464e-8023-755c46865eaa/server/0.log"
Jul 21 13:37:58.943278 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:58.943245    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qmqff_d142ea37-b32e-4261-a6fb-22edae766894/manager/0.log"
Jul 21 13:37:59.140898 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:59.140855    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-rms67_4780c830-e1ff-4477-bb11-c83ef287d343/manager/0.log"
Jul 21 13:37:59.187714 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:59.187661    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f884b5-rms67_4780c830-e1ff-4477-bb11-c83ef287d343/copy-manifests/0.log"
Jul 21 13:37:59.855703 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:59.855669    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d6bb59bf6-gc2hv_6f0b535a-395d-437b-90eb-48452adf85d2/kube-auth-proxy/0.log"
Jul 21 13:37:59.948698 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:37:59.948666    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zspzq_54914c2e-4bb9-4317-bf24-2a3a401ad507/payload-pre-processing/0.log"
Jul 21 13:38:00.606570 ip-10-0-140-67 kubenswrapper[2532]: I0721 13:38:00.606539    2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-422g6_07ce15a0-708c-4a0c-8f2f-5c62e9f19617/openshift-lws-operator/0.log"