Jul 01 16:06:39.736877 ip-10-0-140-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 16:06:39.736888 ip-10-0-140-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 16:06:39.736897 ip-10-0-140-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 16:06:39.737212 ip-10-0-140-101 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 16:06:50.942332 ip-10-0-140-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 16:06:50.942351 ip-10-0-140-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ffee2217a0ed4d46a495ae261b379d3c -- Jul 01 16:08:28.699186 ip-10-0-140-101 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:08:29.015218 ip-10-0-140-101 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:29.015218 ip-10-0-140-101 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:08:29.015218 ip-10-0-140-101 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:29.015684 ip-10-0-140-101 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:08:29.015684 ip-10-0-140-101 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:29.016601 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.016536 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:08:29.021082 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021068 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.021082 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021082 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021085 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021089 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021092 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021095 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021098 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021100 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021103 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021106 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021109 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021111 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021114 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021117 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021119 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021131 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021134 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021137 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021139 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021142 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021145 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.021152 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021147 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021150 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021153 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021156 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021159 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021162 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021165 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021168 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021171 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021173 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021176 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021179 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021183 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021187 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021190 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021192 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021194 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021197 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021199 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.021628 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021202 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021205 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021207 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021210 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021212 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021215 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021218 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021220 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021222 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021225 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021228 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021230 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021233 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021235 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021238 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021241 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021244 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021247 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021249 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021252 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021254 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.022176 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021257 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021260 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021263 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021267 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021270 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021273 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021277 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021281 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021284 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021287 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021291 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021293 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021296 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021299 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021301 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021304 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021306 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021309 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021312 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.022677 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021314 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021317 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021319 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021322 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021324 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021327 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021330 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021333 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021335 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021338 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021341 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021343 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021346 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021348 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021351 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021353 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021356 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021358 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.021361 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022084 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.023180 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022091 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022094 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022097 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022101 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022104 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022107 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022110 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022113 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022116 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022118 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022121 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022124 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022127 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022130 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022132 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022135 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022137 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022140 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022143 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022145 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.023653 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022148 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022150 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022153 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022155 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022158 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022160 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022163 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022165 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022168 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022171 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022173 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022176 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022178 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022181 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022184 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022186 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022189 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022199 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022202 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022205 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.024192 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022209 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022214 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022218 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022221 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022224 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022227 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022231 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022233 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022236 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022239 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022241 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022244 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022246 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022249 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022251 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022254 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022256 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022259 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022262 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022264 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.024679 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022267 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022269 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022272 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022274 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022277 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022279 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022282 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022285 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022287 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022290 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022293 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022295 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022298 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022301 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022304 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022307 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022309 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022312 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022314 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022316 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.025181 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022319 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022323 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022326 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022330 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022334 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022337 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022340 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022342 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022345 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022349 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022352 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022355 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022357 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022360 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022362 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022365 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022367 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022370 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022772 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.025680 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022781 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022787 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022790 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022794 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022796 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022799 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022802 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022805 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022808 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022810 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022813 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022816 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022818 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022821 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022825 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022828 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022831 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022834 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022837 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022840 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.026166 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022842 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022845 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022848 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022850 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022853 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022855 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022858 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022861 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022864 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022867 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022870 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022872 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022875 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022879 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022882 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022885 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022888 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022891 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022894 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.026639 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022897 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022900 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022902 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022905 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022907 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022910 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022926 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022931 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022934 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022939 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022941 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022944 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022947 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022949 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022952 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022955 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022958 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022960 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022963 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.027115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022966 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022971 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022974 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022976 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022979 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022981 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022984 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022987 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022989 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022992 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022994 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.022997 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023000 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023003 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023006 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023008 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023011 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023013 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023016 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023020 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.027574 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023022 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023025 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023027 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023030 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023032 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023035 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023037 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023040 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023042 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023045 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023048 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023051 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023053 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023057 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023060 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023063 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023065 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023068 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023072 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023076 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.028066 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023152 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023162 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023172 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023178 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023190 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023196 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023202 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023207 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023210 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023213 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023217 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023222 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023225 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023228 2583 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023231 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023234 2583 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023237 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023240 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023244 2583 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023246 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023250 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023253 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023256 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023259 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:08:29.028637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023262 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023266 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023269 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023272 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023275 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023278 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023281 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023284 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023290 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023293 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023296 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023299 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023302 2583 flags.go:64] FLAG: --enable-server="true" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023306 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023310 2583 flags.go:64] FLAG: --event-burst="100" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023313 2583 flags.go:64] FLAG: --event-qps="50" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023316 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023319 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023322 2583 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023327 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023330 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023333 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023336 2583 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023339 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023342 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:08:29.029251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023345 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023348 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023351 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023354 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023357 2583 flags.go:64] FLAG: --feature-gates="" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023361 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023364 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023367 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023371 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023375 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023378 2583 flags.go:64] FLAG: --help="false" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023381 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023384 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023387 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023390 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023393 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023397 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023399 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023403 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023406 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023411 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023415 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023420 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023423 2583 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:08:29.029911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023426 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023429 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023433 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023435 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023438 2583 flags.go:64] FLAG: --lock-file="" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023441 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023444 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023447 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023452 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023455 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023458 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023461 2583 flags.go:64] FLAG: --logging-format="text" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023464 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023467 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023470 2583 flags.go:64] FLAG: --manifest-url="" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023473 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023478 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023482 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023485 2583 flags.go:64] FLAG: --max-pods="110" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023489 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023492 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023494 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023497 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023500 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023503 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:08:29.030512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023506 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023513 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023516 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023519 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023522 2583 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023525 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023530 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023533 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023536 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023540 2583 flags.go:64] FLAG: --port="10250" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023543 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023546 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d145ab462878d4d" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023549 2583 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023552 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023555 2583 flags.go:64] FLAG: --register-node="true" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023558 2583 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023561 2583 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023564 2583 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023567 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023570 2583 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023573 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023576 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023579 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023582 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023586 2583 flags.go:64] FLAG: --runonce="false" Jul 01 16:08:29.031149 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023589 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023592 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023594 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023597 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023600 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023603 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023606 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023609 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023612 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023615 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023617 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023620 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023623 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023626 2583 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023629 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023634 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023639 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023642 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023646 2583 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023648 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023651 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023654 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023657 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023660 2583 flags.go:64] FLAG: --v="2" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023664 2583 flags.go:64] FLAG: --version="false" Jul 01 16:08:29.031734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023668 2583 flags.go:64] FLAG: --vmodule="" Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023672 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.023675 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023785 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023789 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023792 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023795 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023798 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023800 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023803 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023805 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023808 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023811 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023813 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023816 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023818 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023821 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023824 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023827 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023829 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.032685 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023832 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023835 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023838 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023842 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023844 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023847 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023849 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023852 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023855 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023857 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023860 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023863 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023865 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023868 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023870 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023873 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023876 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023879 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023882 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023884 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.033494 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023887 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023890 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023892 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023895 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023897 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023900 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023903 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023906 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023908 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023911 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023927 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023929 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023932 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023935 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023938 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023942 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023944 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023947 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023950 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023952 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.034196 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023955 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023957 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023960 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023963 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023966 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023968 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023971 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023973 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023976 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023979 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023982 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023985 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023990 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023993 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023996 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.023999 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024002 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024005 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024008 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.034801 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024010 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024013 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024015 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024018 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024022 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024025 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024028 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024031 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024035 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024038 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024040 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024044 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024048 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024051 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024054 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024056 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024060 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024062 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024065 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.035319 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024068 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024070 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024073 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.024076 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.024597 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.030293 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.030307 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.030326 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.030332 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030384 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030389 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030393 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030396 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030399 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.035824 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030402 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030404 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030407 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030410 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030412 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030415 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030417 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030421 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030425 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030428 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030431 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030434 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030436 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030439 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030442 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030445 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030447 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030450 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030452 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.036292 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030455 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030457 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030460 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030462 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030465 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030469 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030472 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030474 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030477 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030479 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030482 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030485 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030487 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030490 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030492 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030495 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030497 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030500 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030503 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030505 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.036805 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030508 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030510 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030513 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030515 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030518 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030520 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030523 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030526 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030529 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030532 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030535 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030537 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030540 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030544 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030547 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030550 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030553 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030557 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030561 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030564 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.037333 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030566 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030569 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030572 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030575 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030577 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030580 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030582 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030585 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030587 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030590 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030593 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030595 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030598 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030600 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030603 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030605 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030608 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030610 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030613 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030615 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.038129 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030618 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030621 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030623 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030626 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030628 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030632 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030636 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030639 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030642 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030645 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030647 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030650 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030652 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030655 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030657 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.038949 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.030662 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030764 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030769 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030772 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030775 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030778 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030781 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030783 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030786 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030789 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030792 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030794 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030797 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030800 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030803 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030805 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030808 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030810 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030813 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:29.039579 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030816 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030819 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030823 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030826 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030830 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030833 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030836 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030839 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030841 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030844 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030848 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030851 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030853 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030856 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030859 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030861 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030864 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030866 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030869 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:29.040229 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030871 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030874 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030877 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030879 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030881 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030884 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030887 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030889 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030892 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030894 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030897 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030899 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030902 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030905 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030907 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030910 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030928 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030932 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030935 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030937 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:29.040731 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030941 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030945 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030948 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030952 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030955 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030958 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030960 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030963 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030966 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030968 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030970 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030973 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030975 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030978 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030980 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030983 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030986 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030988 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030991 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030993 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:29.041359 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030996 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.030999 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031001 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031004 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031006 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031009 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031011 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031014 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031016 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031019 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031021 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031024 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031027 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031029 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031032 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031034 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031037 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031040 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031042 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031045 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:29.041887 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031047 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:29.031050 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.031054 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.031165 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.034498 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.035686 2583 server.go:1019] "Starting client certificate rotation" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.035789 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.035828 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.038165 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:08:29.042469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.039813 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:08:29.046993 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.046978 2583 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:08:29.050377 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.050363 2583 log.go:25] "Validated CRI v1 image API" Jul 01 16:08:29.051177 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.051130 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:08:29.056714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.056698 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c1c6da85-bcac-4fa5-be91-639065f66edd:/dev/nvme0n1p3 fcb08885-03b2-4be6-b69f-e14528d1b746:/dev/nvme0n1p4] Jul 01 16:08:29.056771 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.056714 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:08:29.061368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.061270 2583 manager.go:216] Machine: {Timestamp:2026-07-01 16:08:29.06080432 +0000 UTC m=+0.268229184 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105046 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21aa5f5939edb3f817d3561f8df385 SystemUUID:ec21aa5f-5939-edb3-f817-d3561f8df385 BootID:ffee2217-a0ed-4d46-a495-ae261b379d3c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:fb:86:c5:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:fb:86:c5:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:15:95:ca:79:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:08:29.061368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.061360 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:08:29.061480 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.061419 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:08:29.063994 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.063966 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:08:29.064125 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.063998 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:08:29.064600 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.064591 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:08:29.064630 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.064602 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:08:29.064630 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.064609 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:08:29.065119 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.065102 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:08:29.065197 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.065184 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:08:29.065947 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.065936 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:08:29.069740 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069728 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:08:29.069857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069847 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:08:29.069905 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069876 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:08:29.069905 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069885 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:08:29.069995 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069927 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:08:29.069995 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069938 2583 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:08:29.069995 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.069947 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:08:29.070425 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.070405 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:08:29.070464 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.070444 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:08:29.073728 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.073688 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:08:29.075152 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075137 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:08:29.075208 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075168 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:08:29.075699 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075689 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:08:29.075735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075705 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:08:29.075735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075711 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:08:29.075735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075716 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:08:29.075735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075725 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:08:29.075735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075730 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075738 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075744 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075750 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075755 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075763 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:08:29.075859 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.075768 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:08:29.076367 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.076354 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:08:29.076367 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.076367 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:08:29.079356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.079341 2583 server.go:1268] "Started kubelet" Jul 01 16:08:29.079515 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.079437 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:08:29.079582 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.079534 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:08:29.079582 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.079526 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:08:29.080049 ip-10-0-140-101 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:08:29.080716 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.080609 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:08:29.081824 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.081779 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:08:29.081935 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.081826 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:08:29.081935 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.081848 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:08:29.081935 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.081865 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:08:29.083613 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.083582 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:08:29.084563 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.083814 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-101.ec2.internal.18be36363ddceeb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-101.ec2.internal,UID:ip-10-0-140-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-101.ec2.internal,},FirstTimestamp:2026-07-01 16:08:29.079318197 +0000 UTC m=+0.286743061,LastTimestamp:2026-07-01 16:08:29.079318197 +0000 UTC m=+0.286743061,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-101.ec2.internal,}" Jul 01 16:08:29.086159 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086143 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:08:29.086230 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086159 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:08:29.086314 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.086294 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:29.086770 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086749 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:08:29.086864 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086750 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:08:29.086864 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086801 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:08:29.086994 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086942 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:08:29.086994 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.086950 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:08:29.087083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087038 2583 factory.go:55] Registering systemd factory Jul 01 16:08:29.087083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087054 2583 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:08:29.087266 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087250 2583 factory.go:153] Registering CRI-O factory Jul 01 16:08:29.087266 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087268 2583 factory.go:223] Registration of the crio container factory successfully Jul 01 16:08:29.087391 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087316 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:08:29.087391 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087334 2583 factory.go:103] Registering Raw factory Jul 01 16:08:29.087391 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.087344 2583 manager.go:1196] Started watching for new ooms in manager Jul 01 16:08:29.087944 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.087886 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:08:29.088035 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.088022 2583 manager.go:349] Starting recovery of all containers Jul 01 16:08:29.088119 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.088080 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:08:29.100124 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.100103 2583 manager.go:354] Recovery completed Jul 01 16:08:29.101621 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.101602 2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 01 16:08:29.104543 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.104531 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.106284 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106259 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.106368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106295 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.106368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106304 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.106771 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106756 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:08:29.106771 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106767 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:08:29.106883 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106769 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.106883 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.106781 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:08:29.107418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.107404 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.107508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.107432 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.107508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.107445 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.108645 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.108585 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-101.ec2.internal.18be36363f7863c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-101.ec2.internal,UID:ip-10-0-140-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-101.ec2.internal,},FirstTimestamp:2026-07-01 16:08:29.106283465 +0000 UTC m=+0.313708329,LastTimestamp:2026-07-01 16:08:29.106283465 +0000 UTC m=+0.313708329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-101.ec2.internal,}" Jul 01 16:08:29.108880 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.108868 2583 policy_none.go:49] "None policy: Start" Jul 01 16:08:29.108957 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.108884 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:08:29.108957 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.108894 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:08:29.110796 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.110784 2583 policy_none.go:47] "Start" Jul 01 16:08:29.112866 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.112766 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pmhkt" Jul 01 16:08:29.117850 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.117766 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-101.ec2.internal.18be36363f78a378 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-101.ec2.internal,UID:ip-10-0-140-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-101.ec2.internal,},FirstTimestamp:2026-07-01 16:08:29.106299768 +0000 UTC m=+0.313724632,LastTimestamp:2026-07-01 16:08:29.106299768 +0000 UTC m=+0.313724632,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-101.ec2.internal,}" Jul 01 16:08:29.121395 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.121340 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-101.ec2.internal.18be36363f78c58c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-101.ec2.internal,UID:ip-10-0-140-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-101.ec2.internal,},FirstTimestamp:2026-07-01 16:08:29.106308492 +0000 UTC m=+0.313733357,LastTimestamp:2026-07-01 16:08:29.106308492 +0000 UTC m=+0.313733357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-101.ec2.internal,}" Jul 01 16:08:29.123073 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.123058 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pmhkt" Jul 01 16:08:29.127728 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.127653 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-101.ec2.internal.18be36363f7863c9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-101.ec2.internal.18be36363f7863c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-101.ec2.internal,UID:ip-10-0-140-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-101.ec2.internal,},FirstTimestamp:2026-07-01 16:08:29.106283465 +0000 UTC m=+0.313708329,LastTimestamp:2026-07-01 16:08:29.107416916 +0000 UTC m=+0.314841787,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-101.ec2.internal,}" Jul 01 16:08:29.147455 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147439 2583 manager.go:337] "Starting Device Plugin manager" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.147471 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147480 2583 server.go:87] "Starting device plugin registration server" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147661 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147672 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147756 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147826 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.147834 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.148307 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.148354 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.151183 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.152362 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.152392 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.152409 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.152436 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:08:29.170825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.154862 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:29.248050 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.248023 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.249599 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.249583 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.249685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.249614 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.249685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.249629 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.249685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.249655 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.252629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.252612 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal"] Jul 01 16:08:29.252692 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.252659 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.253342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.253328 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.253411 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.253352 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.253411 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.253363 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.255624 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.255612 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.255727 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.255712 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.255763 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.255748 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.256310 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256294 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.256310 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256301 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.256434 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256323 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.256434 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256338 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.256434 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256323 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.256434 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.256413 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.258674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.258660 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.258739 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.258683 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-101.ec2.internal\": node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:29.258791 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.258662 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.258791 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.258776 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:29.259458 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.259443 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:29.259540 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.259469 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:29.259540 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.259483 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:29.280569 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.280509 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:29.284429 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.284411 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-101.ec2.internal\" not found" node="ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.288471 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.288452 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1eb05d8c188be55ea323d7190a91915-config\") pod \"kube-apiserver-proxy-ip-10-0-140-101.ec2.internal\" (UID: \"f1eb05d8c188be55ea323d7190a91915\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.288552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.288480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.288552 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.288499 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-101.ec2.internal\" not found" node="ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.288552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.288506 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.381610 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.381591 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:29.389483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389467 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1eb05d8c188be55ea323d7190a91915-config\") pod \"kube-apiserver-proxy-ip-10-0-140-101.ec2.internal\" (UID: \"f1eb05d8c188be55ea323d7190a91915\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.389546 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.389546 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389508 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.389546 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389536 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.389637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1eb05d8c188be55ea323d7190a91915-config\") pod \"kube-apiserver-proxy-ip-10-0-140-101.ec2.internal\" (UID: \"f1eb05d8c188be55ea323d7190a91915\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.389637 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:29.389583 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7794c2b5a13e56771c19afd1ad83ce1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal\" (UID: \"7794c2b5a13e56771c19afd1ad83ce1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:29.482213 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:29.482181 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:30.590917 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:30.590872 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:30.595076 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:30.595062 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:30.600208 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:30.600191 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:30.691404 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:30.691379 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:30.791944 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:30.791912 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:30.892438 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:30.892384 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:30.992964 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:30.992938 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:31.043417 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.043387 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:08:31.043907 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.043525 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:08:31.093151 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:31.093133 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-101.ec2.internal\" not found" Jul 01 16:08:31.128258 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.128234 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:31.135824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.135798 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:03:30 +0000 UTC" deadline="2027-12-17 12:28:03.799254275 +0000 UTC" Jul 01 16:08:31.135914 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.135825 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12812h19m32.66343242s" Jul 01 16:08:31.177499 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.177458 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:31.194294 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.194273 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" Jul 01 16:08:31.196899 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:31.196875 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7794c2b5a13e56771c19afd1ad83ce1d.slice/crio-3a7be94fe06a622417f68801f535da7a262eea414283533bafea1e5d9071f6a7 WatchSource:0}: Error finding container 3a7be94fe06a622417f68801f535da7a262eea414283533bafea1e5d9071f6a7: Status 404 returned error can't find the container with id 3a7be94fe06a622417f68801f535da7a262eea414283533bafea1e5d9071f6a7 Jul 01 16:08:31.197663 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:31.197646 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1eb05d8c188be55ea323d7190a91915.slice/crio-1c8f8716d15567ccf344fb107b00b729433904d37dbf8ad3c22df87432f15103 WatchSource:0}: Error finding container 1c8f8716d15567ccf344fb107b00b729433904d37dbf8ad3c22df87432f15103: Status 404 returned error can't find the container with id 1c8f8716d15567ccf344fb107b00b729433904d37dbf8ad3c22df87432f15103 Jul 01 16:08:31.201780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.201764 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:08:31.203261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.203245 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:08:31.204075 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.204062 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" Jul 01 16:08:31.216441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.216422 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:08:31.606229 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:31.606182 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:32.079443 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.079372 2583 apiserver.go:52] "Watching apiserver" Jul 01 16:08:32.089254 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.089230 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:08:32.089799 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.089773 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xxqk5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx","openshift-cluster-node-tuning-operator/tuned-wkm97","openshift-dns/node-resolver-6lp54","openshift-image-registry/node-ca-snb6k","openshift-multus/multus-additional-cni-plugins-phgpw","openshift-multus/multus-m9lb2","openshift-network-diagnostics/network-check-target-kgz6x","openshift-network-operator/iptables-alerter-hlqds","kube-system/global-pull-secret-syncer-cfdhs","kube-system/konnectivity-agent-wsppj","kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal","openshift-multus/network-metrics-daemon-96fqf"] Jul 01 16:08:32.092286 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.092262 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.094450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.094428 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:08:32.094551 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.094450 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.095478 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.095446 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.095478 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.095454 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:08:32.095622 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.095456 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:08:32.095622 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.095539 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.095853 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.095817 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jrq6f\"" Jul 01 16:08:32.096746 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.096638 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.097958 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.097941 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:08:32.098048 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.097947 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:08:32.098237 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.098218 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phhrz\"" Jul 01 16:08:32.099159 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.098863 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.099581 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.099476 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.099778 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.099695 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdhdl\"" Jul 01 16:08:32.099778 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.099730 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.101108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.101090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.101780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.101608 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.101780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.101628 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-svqpf\"" Jul 01 16:08:32.101970 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.101953 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.103369 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.103349 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.104138 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.104118 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.104227 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.104164 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.104409 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.104386 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8m965\"" Jul 01 16:08:32.104522 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.104505 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:08:32.105469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105361 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-socket-dir-parent\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105393 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-netns\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105418 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-etc-kubernetes\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105440 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-sys\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105478 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-tuned\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105518 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-hostroot\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-conf-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f69fb28-7990-4b7b-b397-ef34ae18cef1-agent-certs\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105660 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-k8s-cni-cncf-io\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.105707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-multus-daemon-config\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105725 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-conf\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-lib-modules\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105774 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-host\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-system-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105831 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-kubelet\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysconfig\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-var-lib-kubelet\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-multus\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.105994 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f69fb28-7990-4b7b-b397-ef34ae18cef1-konnectivity-ca\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-kubernetes\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7m5\" (UniqueName: \"kubernetes.io/projected/47366ad9-8134-4628-bf7d-d71d1bf35644-kube-api-access-lh7m5\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-cnibin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106089 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-bin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-modprobe-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-run\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-cni-binary-copy\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106246 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-multus-certs\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6stqq\" (UniqueName: \"kubernetes.io/projected/6be76201-edc2-47df-8333-a5a34286e8fe-kube-api-access-6stqq\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-systemd\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-tmp\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.106678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-os-release\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.107097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106740 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:08:32.107097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.106787 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nrcz\"" Jul 01 16:08:32.107097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.107083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:08:32.107960 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.107934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.108045 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.108009 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:32.108494 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.108380 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.108494 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.108407 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.108780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.108737 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wkqvc\"" Jul 01 16:08:32.108780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.108753 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:08:32.109106 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.109086 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:08:32.110695 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.110632 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.114326 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.114270 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:08:32.114530 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.114510 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.114670 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.114648 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.114914 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.114884 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:32.115015 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.114941 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.115552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.115534 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9p7v\"" Jul 01 16:08:32.116757 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.116735 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.119167 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.119149 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:32.119268 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.119208 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:32.119560 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.119540 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.120928 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.121086 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.121169 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5mvt\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.121172 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.121311 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:08:32.121613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.121485 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:08:32.129785 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.129747 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjjnj" Jul 01 16:08:32.139174 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.139152 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjjnj" Jul 01 16:08:32.165259 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.165213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" event={"ID":"f1eb05d8c188be55ea323d7190a91915","Type":"ContainerStarted","Data":"1c8f8716d15567ccf344fb107b00b729433904d37dbf8ad3c22df87432f15103"} Jul 01 16:08:32.166708 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.166665 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" event={"ID":"7794c2b5a13e56771c19afd1ad83ce1d","Type":"ContainerStarted","Data":"3a7be94fe06a622417f68801f535da7a262eea414283533bafea1e5d9071f6a7"} Jul 01 16:08:32.196635 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.196615 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:08:32.206508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206483 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-cni-binary-copy\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.206607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206519 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-multus-certs\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.206607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206545 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-systemd\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.206607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206572 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-registration-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.206607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206598 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-sys-fs\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-var-lib-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206634 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-multus-certs\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-socket-dir-parent\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-sys\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206694 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-systemd\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/077c0274-d67e-4e09-ac48-afd0803627b6-iptables-alerter-script\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206740 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-socket-dir-parent\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206753 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-sys\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.206810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/077c0274-d67e-4e09-ac48-afd0803627b6-host-slash\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206828 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-systemd-units\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-config\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206902 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-env-overrides\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206938 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-script-lib\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-hostroot\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.206991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-conf-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-socket-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-hostroot\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-node-log\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207074 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-conf-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmz99\" (UniqueName: \"kubernetes.io/projected/d6a5676b-37b9-4dc2-aedd-f88738e7d645-kube-api-access-qmz99\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207073 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-cni-binary-copy\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-system-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysconfig\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207241 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysconfig\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.207272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207267 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-multus-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207290 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-system-cni-dir\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-multus\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24162509-d5ad-4c93-884a-b2be4b44c6ef-tmp-dir\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-dbus\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-os-release\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207403 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-multus\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sqzc\" (UniqueName: \"kubernetes.io/projected/a33db57f-5763-4cff-9728-5dd46e918c7a-kube-api-access-5sqzc\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207433 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207462 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-bin\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-cnibin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207508 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkq5g\" (UniqueName: \"kubernetes.io/projected/077c0274-d67e-4e09-ac48-afd0803627b6-kube-api-access-jkq5g\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207532 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5g2l\" (UniqueName: \"kubernetes.io/projected/18f343be-0b67-44db-85a8-ab535755108c-kube-api-access-s5g2l\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-slash\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-modprobe-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-run\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207611 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-cnibin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207618 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-kubelet\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207654 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-log-socket\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207664 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-run\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207684 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207698 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-modprobe-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6stqq\" (UniqueName: \"kubernetes.io/projected/6be76201-edc2-47df-8333-a5a34286e8fe-kube-api-access-6stqq\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-tmp\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24162509-d5ad-4c93-884a-b2be4b44c6ef-hosts-file\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207867 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-cnibin\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-os-release\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-netns\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.207978 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-etc-kubernetes\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-tuned\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208026 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkw8\" (UniqueName: \"kubernetes.io/projected/24162509-d5ad-4c93-884a-b2be4b44c6ef-kube-api-access-chkw8\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.208942 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208048 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-os-release\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63b5239a-337a-4117-9c86-1cc825a23789-serviceca\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208094 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-netns\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208107 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxjj\" (UniqueName: \"kubernetes.io/projected/63b5239a-337a-4117-9c86-1cc825a23789-kube-api-access-9rxjj\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-device-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208130 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-etc-kubernetes\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208103 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f69fb28-7990-4b7b-b397-ef34ae18cef1-agent-certs\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-netd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-k8s-cni-cncf-io\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-multus-daemon-config\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-conf\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208784 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6be76201-edc2-47df-8333-a5a34286e8fe-multus-daemon-config\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-lib-modules\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-host\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.209769 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208927 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-etc-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-kubelet\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.208999 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-var-lib-kubelet\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209062 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209113 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-systemd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-ovn\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209185 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovn-node-metrics-cert\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f69fb28-7990-4b7b-b397-ef34ae18cef1-konnectivity-ca\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-kubernetes\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209261 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7m5\" (UniqueName: \"kubernetes.io/projected/47366ad9-8134-4628-bf7d-d71d1bf35644-kube-api-access-lh7m5\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209283 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63b5239a-337a-4117-9c86-1cc825a23789-host\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-system-cni-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209445 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-netns\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209473 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-bin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.210598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209498 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209525 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgkd\" (UniqueName: \"kubernetes.io/projected/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kube-api-access-llgkd\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-kubelet-config\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209639 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-var-lib-kubelet\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-kubernetes\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-cni-bin\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209730 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-conf\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209785 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-host\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209799 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-lib-modules\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209833 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-var-lib-kubelet\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209955 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-sysctl-d\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.209996 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6be76201-edc2-47df-8333-a5a34286e8fe-host-run-k8s-cni-cncf-io\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.211490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.210183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f69fb28-7990-4b7b-b397-ef34ae18cef1-konnectivity-ca\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.212553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.212531 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-tmp\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.212661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.212639 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f69fb28-7990-4b7b-b397-ef34ae18cef1-agent-certs\") pod \"konnectivity-agent-wsppj\" (UID: \"4f69fb28-7990-4b7b-b397-ef34ae18cef1\") " pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.214055 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.214016 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47366ad9-8134-4628-bf7d-d71d1bf35644-etc-tuned\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.220591 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.220571 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7m5\" (UniqueName: \"kubernetes.io/projected/47366ad9-8134-4628-bf7d-d71d1bf35644-kube-api-access-lh7m5\") pod \"tuned-wkm97\" (UID: \"47366ad9-8134-4628-bf7d-d71d1bf35644\") " pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.220697 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.220663 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6stqq\" (UniqueName: \"kubernetes.io/projected/6be76201-edc2-47df-8333-a5a34286e8fe-kube-api-access-6stqq\") pod \"multus-m9lb2\" (UID: \"6be76201-edc2-47df-8333-a5a34286e8fe\") " pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.310237 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24162509-d5ad-4c93-884a-b2be4b44c6ef-hosts-file\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-cnibin\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkw8\" (UniqueName: \"kubernetes.io/projected/24162509-d5ad-4c93-884a-b2be4b44c6ef-kube-api-access-chkw8\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310341 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24162509-d5ad-4c93-884a-b2be4b44c6ef-hosts-file\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63b5239a-337a-4117-9c86-1cc825a23789-serviceca\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.310390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310378 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-cnibin\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310383 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310383 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxjj\" (UniqueName: \"kubernetes.io/projected/63b5239a-337a-4117-9c86-1cc825a23789-kube-api-access-9rxjj\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-device-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310498 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-netd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310528 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-etc-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310583 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-netd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310655 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-systemd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-ovn\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovn-node-metrics-cert\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.310732 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63b5239a-337a-4117-9c86-1cc825a23789-host\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.310750 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310760 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63b5239a-337a-4117-9c86-1cc825a23789-serviceca\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310766 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310586 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-device-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.310812 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:08:32.810792034 +0000 UTC m=+3.010293713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310815 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-ovn\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310631 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-etc-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310676 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310879 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63b5239a-337a-4117-9c86-1cc825a23789-host\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310903 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-run-systemd\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.310823 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310974 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-system-cni-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.310941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-system-cni-dir\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.310997 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:32.810981986 +0000 UTC m=+3.010483649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311045 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-netns\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.311553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgkd\" (UniqueName: \"kubernetes.io/projected/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kube-api-access-llgkd\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311099 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-kubelet-config\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-netns\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-registration-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-sys-fs\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311184 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-kubelet-config\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-var-lib-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311231 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-registration-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/077c0274-d67e-4e09-ac48-afd0803627b6-iptables-alerter-script\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311269 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/077c0274-d67e-4e09-ac48-afd0803627b6-host-slash\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311274 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-var-lib-openvswitch\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311248 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-sys-fs\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-systemd-units\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-config\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/077c0274-d67e-4e09-ac48-afd0803627b6-host-slash\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.312383 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311337 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-env-overrides\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311368 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-script-lib\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311397 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-socket-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311400 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-systemd-units\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311506 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-socket-dir\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-node-log\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311562 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmz99\" (UniqueName: \"kubernetes.io/projected/d6a5676b-37b9-4dc2-aedd-f88738e7d645-kube-api-access-qmz99\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24162509-d5ad-4c93-884a-b2be4b44c6ef-tmp-dir\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-dbus\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-os-release\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sqzc\" (UniqueName: \"kubernetes.io/projected/a33db57f-5763-4cff-9728-5dd46e918c7a-kube-api-access-5sqzc\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311731 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/077c0274-d67e-4e09-ac48-afd0803627b6-iptables-alerter-script\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-bin\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311773 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-env-overrides\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311821 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.313264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311984 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dad4524-90ec-4f37-99ea-d45a476cb682-dbus\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.311775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkq5g\" (UniqueName: \"kubernetes.io/projected/077c0274-d67e-4e09-ac48-afd0803627b6-kube-api-access-jkq5g\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312003 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24162509-d5ad-4c93-884a-b2be4b44c6ef-tmp-dir\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5g2l\" (UniqueName: \"kubernetes.io/projected/18f343be-0b67-44db-85a8-ab535755108c-kube-api-access-s5g2l\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312042 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33db57f-5763-4cff-9728-5dd46e918c7a-os-release\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312049 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-node-log\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-slash\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312082 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-cni-bin\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-kubelet\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-log-socket\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312138 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312306 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312355 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-kubelet\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312355 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-host-slash\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312391 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6a5676b-37b9-4dc2-aedd-f88738e7d645-log-socket\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312752 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.312990 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-script-lib\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.313112 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33db57f-5763-4cff-9728-5dd46e918c7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.314825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.313319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovnkube-config\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.314825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.313750 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6a5676b-37b9-4dc2-aedd-f88738e7d645-ovn-node-metrics-cert\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.322084 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.322061 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:32.322084 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.322085 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:32.322243 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.322099 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:32.322243 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.322154 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:08:32.822138852 +0000 UTC m=+3.021640514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:32.322853 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.322817 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkw8\" (UniqueName: \"kubernetes.io/projected/24162509-d5ad-4c93-884a-b2be4b44c6ef-kube-api-access-chkw8\") pod \"node-resolver-6lp54\" (UID: \"24162509-d5ad-4c93-884a-b2be4b44c6ef\") " pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.323035 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.322992 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxjj\" (UniqueName: \"kubernetes.io/projected/63b5239a-337a-4117-9c86-1cc825a23789-kube-api-access-9rxjj\") pod \"node-ca-snb6k\" (UID: \"63b5239a-337a-4117-9c86-1cc825a23789\") " pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.324485 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.324462 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkq5g\" (UniqueName: \"kubernetes.io/projected/077c0274-d67e-4e09-ac48-afd0803627b6-kube-api-access-jkq5g\") pod \"iptables-alerter-hlqds\" (UID: \"077c0274-d67e-4e09-ac48-afd0803627b6\") " pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.324782 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.324767 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sqzc\" (UniqueName: \"kubernetes.io/projected/a33db57f-5763-4cff-9728-5dd46e918c7a-kube-api-access-5sqzc\") pod \"multus-additional-cni-plugins-phgpw\" (UID: \"a33db57f-5763-4cff-9728-5dd46e918c7a\") " pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.328622 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.328597 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5g2l\" (UniqueName: \"kubernetes.io/projected/18f343be-0b67-44db-85a8-ab535755108c-kube-api-access-s5g2l\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.328722 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.328709 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgkd\" (UniqueName: \"kubernetes.io/projected/4ce665e3-2125-4e5f-bb3e-41bfc01087e3-kube-api-access-llgkd\") pod \"aws-ebs-csi-driver-node-pljmx\" (UID: \"4ce665e3-2125-4e5f-bb3e-41bfc01087e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.329319 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.329300 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmz99\" (UniqueName: \"kubernetes.io/projected/d6a5676b-37b9-4dc2-aedd-f88738e7d645-kube-api-access-qmz99\") pod \"ovnkube-node-xxqk5\" (UID: \"d6a5676b-37b9-4dc2-aedd-f88738e7d645\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.406140 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.406096 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9lb2" Jul 01 16:08:32.414185 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.414166 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkm97" Jul 01 16:08:32.425734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.425714 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:32.431390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.431371 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lp54" Jul 01 16:08:32.438903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.438882 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-snb6k" Jul 01 16:08:32.446501 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.446485 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phgpw" Jul 01 16:08:32.454071 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.454054 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hlqds" Jul 01 16:08:32.461567 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.461550 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" Jul 01 16:08:32.465317 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.465298 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:32.466396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.466382 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:08:32.816068 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.815994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:32.816068 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.816027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:32.816242 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.816161 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:32.816242 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.816210 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:32.816242 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.816236 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:08:33.816215669 +0000 UTC m=+4.015717340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:32.816383 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.816259 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:33.816244484 +0000 UTC m=+4.015746144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:32.917150 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:32.917114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:32.917326 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.917265 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:32.917326 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.917284 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:32.917326 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.917296 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:32.917475 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:32.917355 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:08:33.917337015 +0000 UTC m=+4.116838684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:33.142752 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:33.142676 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:03:32 +0000 UTC" deadline="2028-01-09 03:09:32.202781092 +0000 UTC" Jul 01 16:08:33.142752 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:33.142706 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13355h0m59.060079937s" Jul 01 16:08:33.224295 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.224262 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f69fb28_7990_4b7b_b397_ef34ae18cef1.slice/crio-4a270edbb261b08adddfa6dd28779527a585641e18562ae06a9127d6a233495f WatchSource:0}: Error finding container 4a270edbb261b08adddfa6dd28779527a585641e18562ae06a9127d6a233495f: Status 404 returned error can't find the container with id 4a270edbb261b08adddfa6dd28779527a585641e18562ae06a9127d6a233495f Jul 01 16:08:33.225405 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.225375 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24162509_d5ad_4c93_884a_b2be4b44c6ef.slice/crio-d63d63f7a3f8d46ac57faf56972aaf43b8643e253dab4e9ac0063199d56e5787 WatchSource:0}: Error finding container d63d63f7a3f8d46ac57faf56972aaf43b8643e253dab4e9ac0063199d56e5787: Status 404 returned error can't find the container with id d63d63f7a3f8d46ac57faf56972aaf43b8643e253dab4e9ac0063199d56e5787 Jul 01 16:08:33.226698 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.226675 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077c0274_d67e_4e09_ac48_afd0803627b6.slice/crio-b0f9f6b65c3b4f48f9123e6bcce91d4ef327f18af45694d872d186e4d5d0db5a WatchSource:0}: Error finding container b0f9f6b65c3b4f48f9123e6bcce91d4ef327f18af45694d872d186e4d5d0db5a: Status 404 returned error can't find the container with id b0f9f6b65c3b4f48f9123e6bcce91d4ef327f18af45694d872d186e4d5d0db5a Jul 01 16:08:33.229155 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.229133 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b5239a_337a_4117_9c86_1cc825a23789.slice/crio-241dab9d1fc1eb27db0bf8e994ca164300c01d4111d57b8024615c3a048e945a WatchSource:0}: Error finding container 241dab9d1fc1eb27db0bf8e994ca164300c01d4111d57b8024615c3a048e945a: Status 404 returned error can't find the container with id 241dab9d1fc1eb27db0bf8e994ca164300c01d4111d57b8024615c3a048e945a Jul 01 16:08:33.251198 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.251178 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47366ad9_8134_4628_bf7d_d71d1bf35644.slice/crio-6f53cbf7dd690a96e63fc879c6866a710b8d02e0d0fead2c771819cb065a2f40 WatchSource:0}: Error finding container 6f53cbf7dd690a96e63fc879c6866a710b8d02e0d0fead2c771819cb065a2f40: Status 404 returned error can't find the container with id 6f53cbf7dd690a96e63fc879c6866a710b8d02e0d0fead2c771819cb065a2f40 Jul 01 16:08:33.251952 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.251930 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be76201_edc2_47df_8333_a5a34286e8fe.slice/crio-73f961da36d1315eb5b17cd17463895a7bfbce4c68504f83effeb5267e0e0257 WatchSource:0}: Error finding container 73f961da36d1315eb5b17cd17463895a7bfbce4c68504f83effeb5267e0e0257: Status 404 returned error can't find the container with id 73f961da36d1315eb5b17cd17463895a7bfbce4c68504f83effeb5267e0e0257 Jul 01 16:08:33.252733 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.252665 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce665e3_2125_4e5f_bb3e_41bfc01087e3.slice/crio-a5bd9a6cf283bb7e340aa874073a1691d668ed7857cdd49e64f305b09cce1929 WatchSource:0}: Error finding container a5bd9a6cf283bb7e340aa874073a1691d668ed7857cdd49e64f305b09cce1929: Status 404 returned error can't find the container with id a5bd9a6cf283bb7e340aa874073a1691d668ed7857cdd49e64f305b09cce1929 Jul 01 16:08:33.253784 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.253737 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33db57f_5763_4cff_9728_5dd46e918c7a.slice/crio-2350a32d50b5e491110e26eccc97c5cdb11ac9a00ec994c8c2cffaa1bbe9a2e8 WatchSource:0}: Error finding container 2350a32d50b5e491110e26eccc97c5cdb11ac9a00ec994c8c2cffaa1bbe9a2e8: Status 404 returned error can't find the container with id 2350a32d50b5e491110e26eccc97c5cdb11ac9a00ec994c8c2cffaa1bbe9a2e8 Jul 01 16:08:33.254426 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:08:33.254352 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a5676b_37b9_4dc2_aedd_f88738e7d645.slice/crio-dcfcdf4c48282be052e9cfe5fba29a95d7b3a650e8a1ede01ad97c467efc8c89 WatchSource:0}: Error finding container dcfcdf4c48282be052e9cfe5fba29a95d7b3a650e8a1ede01ad97c467efc8c89: Status 404 returned error can't find the container with id dcfcdf4c48282be052e9cfe5fba29a95d7b3a650e8a1ede01ad97c467efc8c89 Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:33.821900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:33.822244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.822098 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.822438 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:08:35.82241888 +0000 UTC m=+6.021920542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.822380 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:33.822889 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.822781 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:35.822764898 +0000 UTC m=+6.022266563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:33.922926 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:33.922890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:33.923137 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.923119 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:33.923199 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.923145 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:33.923199 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.923157 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:33.923301 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:33.923211 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:08:35.92319372 +0000 UTC m=+6.122695394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:34.143258 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.143153 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:03:32 +0000 UTC" deadline="2028-02-12 00:44:56.736337054 +0000 UTC" Jul 01 16:08:34.143258 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.143216 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14168h36m22.593124355s" Jul 01 16:08:34.163974 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.163946 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:34.164107 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:34.164071 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:34.164780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.164455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:34.164780 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:34.164550 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:34.164780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.164622 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:34.164780 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:34.164707 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:34.183449 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.182716 2583 generic.go:356] "Generic (PLEG): container finished" podID="7794c2b5a13e56771c19afd1ad83ce1d" containerID="d529fd408386760ede4e920362f5536fe9a77802a2212d963e9d87db6a0b94b6" exitCode=0 Jul 01 16:08:34.183449 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.182796 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" event={"ID":"7794c2b5a13e56771c19afd1ad83ce1d","Type":"ContainerDied","Data":"d529fd408386760ede4e920362f5536fe9a77802a2212d963e9d87db6a0b94b6"} Jul 01 16:08:34.187887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.187773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"dcfcdf4c48282be052e9cfe5fba29a95d7b3a650e8a1ede01ad97c467efc8c89"} Jul 01 16:08:34.196656 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.196630 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" event={"ID":"4ce665e3-2125-4e5f-bb3e-41bfc01087e3","Type":"ContainerStarted","Data":"a5bd9a6cf283bb7e340aa874073a1691d668ed7857cdd49e64f305b09cce1929"} Jul 01 16:08:34.209277 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.209213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9lb2" event={"ID":"6be76201-edc2-47df-8333-a5a34286e8fe","Type":"ContainerStarted","Data":"73f961da36d1315eb5b17cd17463895a7bfbce4c68504f83effeb5267e0e0257"} Jul 01 16:08:34.217599 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.217535 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkm97" event={"ID":"47366ad9-8134-4628-bf7d-d71d1bf35644","Type":"ContainerStarted","Data":"6f53cbf7dd690a96e63fc879c6866a710b8d02e0d0fead2c771819cb065a2f40"} Jul 01 16:08:34.230518 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.230438 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hlqds" event={"ID":"077c0274-d67e-4e09-ac48-afd0803627b6","Type":"ContainerStarted","Data":"b0f9f6b65c3b4f48f9123e6bcce91d4ef327f18af45694d872d186e4d5d0db5a"} Jul 01 16:08:34.235830 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.235801 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lp54" event={"ID":"24162509-d5ad-4c93-884a-b2be4b44c6ef","Type":"ContainerStarted","Data":"d63d63f7a3f8d46ac57faf56972aaf43b8643e253dab4e9ac0063199d56e5787"} Jul 01 16:08:34.239607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.239579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" event={"ID":"f1eb05d8c188be55ea323d7190a91915","Type":"ContainerStarted","Data":"1cac2f5b367522cb113eeebcb46ff53173a454db94c5486bb91076432d06dfa0"} Jul 01 16:08:34.252457 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.252406 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerStarted","Data":"2350a32d50b5e491110e26eccc97c5cdb11ac9a00ec994c8c2cffaa1bbe9a2e8"} Jul 01 16:08:34.263661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.263398 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-101.ec2.internal" podStartSLOduration=3.263381286 podStartE2EDuration="3.263381286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:34.263029768 +0000 UTC m=+4.462531450" watchObservedRunningTime="2026-07-01 16:08:34.263381286 +0000 UTC m=+4.462882969" Jul 01 16:08:34.263661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.263617 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-snb6k" event={"ID":"63b5239a-337a-4117-9c86-1cc825a23789","Type":"ContainerStarted","Data":"241dab9d1fc1eb27db0bf8e994ca164300c01d4111d57b8024615c3a048e945a"} Jul 01 16:08:34.270973 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:34.270947 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wsppj" event={"ID":"4f69fb28-7990-4b7b-b397-ef34ae18cef1","Type":"ContainerStarted","Data":"4a270edbb261b08adddfa6dd28779527a585641e18562ae06a9127d6a233495f"} Jul 01 16:08:35.282868 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:35.282757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" event={"ID":"7794c2b5a13e56771c19afd1ad83ce1d","Type":"ContainerStarted","Data":"b6ae40817929d93efa95e83f29bae63cf1e7c493c10c95bea583d643248bc636"} Jul 01 16:08:35.837191 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:35.837154 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:35.837377 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:35.837208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:35.837377 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.837335 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:35.837488 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.837402 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:08:39.837382237 +0000 UTC m=+10.036883900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:35.837717 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.837335 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:35.837717 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.837650 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:39.83762659 +0000 UTC m=+10.037128263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:35.939008 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:35.938382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:35.939008 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.938551 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:35.939008 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.938570 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:35.939008 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.938587 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:35.939008 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:35.938644 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:08:39.938625084 +0000 UTC m=+10.138126753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:36.166964 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:36.167149 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:36.167189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:36.167326 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:36.167391 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:36.171030 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:36.167508 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:38.165063 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:38.165180 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:38.165551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:38.165655 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:38.165709 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:38.165810 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:38.165772 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:39.872076 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:39.872044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:39.872528 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:39.872093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:39.872528 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.872252 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:39.872528 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.872309 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:47.872291659 +0000 UTC m=+18.071793323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:39.872528 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.872485 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:39.872728 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.872535 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:08:47.872519883 +0000 UTC m=+18.072021549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:39.972922 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:39.972884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:39.973098 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.973054 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:39.973098 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.973074 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:39.973098 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.973087 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:39.973261 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:39.973142 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:08:47.973124397 +0000 UTC m=+18.172626079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:40.160534 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:40.160462 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:40.160689 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:40.160573 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:40.161445 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:40.161416 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:40.161553 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:40.161530 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:40.161607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:40.161574 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:40.161660 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:40.161637 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:42.162450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:42.161953 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:42.162450 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:42.162088 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:42.162450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:42.162113 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:42.162450 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:42.162226 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:42.163326 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:42.162538 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:42.163326 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:42.162627 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:44.163806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:44.163776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:44.163806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:44.163796 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:44.164221 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:44.163776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:44.164221 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:44.163917 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:44.164221 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:44.163963 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:44.164221 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:44.164051 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:46.161224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:46.161099 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:46.161224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:46.161135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:46.161224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:46.161107 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:46.161737 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:46.161235 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:46.162126 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:46.162091 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:46.164100 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:46.163096 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:47.936028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:47.935989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:47.936028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:47.936033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:47.936510 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:47.936142 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:47.936510 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:47.936150 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:47.936510 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:47.936190 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:03.936175988 +0000 UTC m=+34.135677652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:47.936510 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:47.936206 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:09:03.936198199 +0000 UTC m=+34.135699861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:48.036541 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:48.036504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:48.036687 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.036660 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:48.036687 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.036682 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:48.036769 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.036694 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:48.036769 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.036760 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:09:04.036738891 +0000 UTC m=+34.236240564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:48.160738 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:48.160709 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:48.160906 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:48.160718 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:48.160906 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.160853 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:48.161016 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.160951 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:48.161070 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:48.161016 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:48.161142 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:48.161111 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:50.161213 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:50.161186 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:50.161662 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:50.161279 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:50.161662 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:50.161334 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:50.161662 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:50.161435 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:50.161662 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:50.161463 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:50.161662 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:50.161546 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.165880 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:52.166238 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.166708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:52.166860 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.166941 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:52.167100 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:52.167090 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:52.316482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.316449 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerStarted","Data":"2515f576afc4be187b2e0aca856a882e2b4b8ed027fac94a72a97debba6f37f7"} Jul 01 16:08:52.317994 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.317970 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-snb6k" event={"ID":"63b5239a-337a-4117-9c86-1cc825a23789","Type":"ContainerStarted","Data":"a8871251ce57c4d86d6c221b3c79a17a2abd97aa2291daa972c58dfc7685d0b5"} Jul 01 16:08:52.319445 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.319412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wsppj" event={"ID":"4f69fb28-7990-4b7b-b397-ef34ae18cef1","Type":"ContainerStarted","Data":"86a209b93a3ea39181b812d6000371086a12d10bf2e9eb6c858507823c624f02"} Jul 01 16:08:52.320777 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.320761 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:08:52.321132 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.321107 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6a5676b-37b9-4dc2-aedd-f88738e7d645" containerID="a9e713517758243040473dff8f8b1ccc0c6ee61b1b48156255dd52199d6d9ace" exitCode=1 Jul 01 16:08:52.321209 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.321180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerDied","Data":"a9e713517758243040473dff8f8b1ccc0c6ee61b1b48156255dd52199d6d9ace"} Jul 01 16:08:52.321272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.321260 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"bdc2594114927a5345ae80c0e3e7e8c48b8a7da82360a6300724d8cff21314cd"} Jul 01 16:08:52.322899 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.322872 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" event={"ID":"4ce665e3-2125-4e5f-bb3e-41bfc01087e3","Type":"ContainerStarted","Data":"40fc5b61b25f5d431ec88cd057211d477a18c4027b922d00058c8e77c5b1f5d3"} Jul 01 16:08:52.324404 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.324382 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9lb2" event={"ID":"6be76201-edc2-47df-8333-a5a34286e8fe","Type":"ContainerStarted","Data":"d8c62a1a1be24aa1995f5aa7ca4d229a931767ffa31aafd7b5c2563def64c5e8"} Jul 01 16:08:52.326361 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.326202 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkm97" event={"ID":"47366ad9-8134-4628-bf7d-d71d1bf35644","Type":"ContainerStarted","Data":"842e009dc5a982ffc6c713771e7b90938c9c02bc95469e4f7dac1ce6f38d9a56"} Jul 01 16:08:52.327770 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.327706 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lp54" event={"ID":"24162509-d5ad-4c93-884a-b2be4b44c6ef","Type":"ContainerStarted","Data":"f3d18279b7108b126d54d5bbec55906f765c662f85cd9afbb7edf1bd8aa47b1b"} Jul 01 16:08:52.342415 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.342374 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-101.ec2.internal" podStartSLOduration=21.342362744 podStartE2EDuration="21.342362744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:35.301023361 +0000 UTC m=+5.500525047" watchObservedRunningTime="2026-07-01 16:08:52.342362744 +0000 UTC m=+22.541864425" Jul 01 16:08:52.358132 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.358095 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m9lb2" podStartSLOduration=3.527787417 podStartE2EDuration="22.358084019s" totalImagesPullingTime="18.830296602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:52.357721483 +0000 UTC m=+22.557223164" watchObservedRunningTime="2026-07-01 16:08:52.358084019 +0000 UTC m=+22.557585700" Jul 01 16:08:52.376073 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.376033 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkm97" podStartSLOduration=3.59536792 podStartE2EDuration="22.376020442s" totalImagesPullingTime="18.780652522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:52.375796099 +0000 UTC m=+22.575297781" watchObservedRunningTime="2026-07-01 16:08:52.376020442 +0000 UTC m=+22.575522122" Jul 01 16:08:52.395729 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.395693 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6lp54" podStartSLOduration=3.602703677 podStartE2EDuration="22.395680524s" totalImagesPullingTime="18.792976847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:52.395440669 +0000 UTC m=+22.594942349" watchObservedRunningTime="2026-07-01 16:08:52.395680524 +0000 UTC m=+22.595182205" Jul 01 16:08:52.419835 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.419783 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wsppj" podStartSLOduration=3.6258718009999997 podStartE2EDuration="22.419764714s" totalImagesPullingTime="18.793892913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:52.416255506 +0000 UTC m=+22.615757188" watchObservedRunningTime="2026-07-01 16:08:52.419764714 +0000 UTC m=+22.619266397" Jul 01 16:08:52.434577 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:52.434526 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-snb6k" podStartSLOduration=3.662710326 podStartE2EDuration="22.434507123s" totalImagesPullingTime="18.771796797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:52.433622301 +0000 UTC m=+22.633123984" watchObservedRunningTime="2026-07-01 16:08:52.434507123 +0000 UTC m=+22.634008835" Jul 01 16:08:53.332640 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.332491 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:08:53.333288 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.333070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"fd58c4dfdeb5ce6327754c435501e98f4b3fcccb5cd9e51189121d9d4ba40557"} Jul 01 16:08:53.333288 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.333165 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"f56432d306f42bb855cddecce5baf3ec54d65acdcf15d123d875e7b889211670"} Jul 01 16:08:53.333288 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.333206 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"9643d796c7226deb72ecc7a7997990832085dd892479f9fa116f173c42c674be"} Jul 01 16:08:53.333288 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.333245 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"27d862b084339208e1ccebb35e6c196796c3e6908af7b86f1ab7e272e0902265"} Jul 01 16:08:53.334519 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.334495 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="2515f576afc4be187b2e0aca856a882e2b4b8ed027fac94a72a97debba6f37f7" exitCode=0 Jul 01 16:08:53.334626 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.334589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"2515f576afc4be187b2e0aca856a882e2b4b8ed027fac94a72a97debba6f37f7"} Jul 01 16:08:53.564912 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:53.564894 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:08:54.161643 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.161569 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:54.161939 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.161568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:54.161939 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:54.161710 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:54.161939 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.161565 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:54.161939 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:54.161788 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:54.161939 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:54.161892 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:54.175631 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.175531 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:08:53.564907509Z","UUID":"39fec5ef-ed31-40f1-a992-09c8ec9e0b4f","Handler":null,"Name":"","Endpoint":""} Jul 01 16:08:54.177382 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.177363 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:08:54.177534 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.177405 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:08:54.338829 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.338801 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" event={"ID":"4ce665e3-2125-4e5f-bb3e-41bfc01087e3","Type":"ContainerStarted","Data":"af1b93b8d98b20945c57576d770f8688e66f002b29c4c11a35022272faf55663"} Jul 01 16:08:54.340559 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.340532 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hlqds" event={"ID":"077c0274-d67e-4e09-ac48-afd0803627b6","Type":"ContainerStarted","Data":"4e9e2b193821e25c652cca4d9457a616a82a55885632125a2353c2d949f1ee83"} Jul 01 16:08:54.355910 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:54.355870 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hlqds" podStartSLOduration=5.586346127 podStartE2EDuration="24.355859333s" totalImagesPullingTime="18.769513206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.355474836 +0000 UTC m=+24.554976518" watchObservedRunningTime="2026-07-01 16:08:54.355859333 +0000 UTC m=+24.555361015" Jul 01 16:08:55.345456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:55.345246 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:08:55.345909 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:55.345792 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"4b83f4af7c397586804c6c14738e59bc595fd2784fcb768930e7c5fb781adcf4"} Jul 01 16:08:55.347747 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:55.347723 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" event={"ID":"4ce665e3-2125-4e5f-bb3e-41bfc01087e3","Type":"ContainerStarted","Data":"40e73cb99467a39bc0d46db6f2d4c0834d0e2290691218f44c2e88bf6ec1d127"} Jul 01 16:08:55.366069 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:55.366005 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pljmx" podStartSLOduration=4.129647935 podStartE2EDuration="25.365987437s" totalImagesPullingTime="21.236339502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:55.365023425 +0000 UTC m=+25.564525119" watchObservedRunningTime="2026-07-01 16:08:55.365987437 +0000 UTC m=+25.565489125" Jul 01 16:08:56.161303 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:56.161261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:56.161303 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:56.161287 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:56.164297 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:56.161713 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:56.164297 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:56.161797 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:56.164297 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:56.161972 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:56.164297 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:56.162148 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:56.419773 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:56.419704 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:56.420397 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:56.420383 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:57.351219 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:57.351149 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:57.351619 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:57.351602 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wsppj" Jul 01 16:08:58.160953 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:58.160924 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:08:58.161458 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:58.160955 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:08:58.161458 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:58.161023 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:08:58.161458 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:58.161139 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:08:58.161458 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:58.161210 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:08:58.161458 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:08:58.161279 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:08:59.357944 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:59.357658 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="c69a5de1017629b44fc6b77eaf1398b2a1450afe0a2eab45c6b6fe52aa981cd8" exitCode=0 Jul 01 16:08:59.358521 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:59.357751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"c69a5de1017629b44fc6b77eaf1398b2a1450afe0a2eab45c6b6fe52aa981cd8"} Jul 01 16:08:59.362385 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:59.362365 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:08:59.362827 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:59.362793 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"c5c9dd338bfa658c4001ea558a4116db87b22130faeeb7d519ac405df46e4bd0"} Jul 01 16:08:59.363367 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:08:59.363348 2583 scope.go:117] "RemoveContainer" containerID="a9e713517758243040473dff8f8b1ccc0c6ee61b1b48156255dd52199d6d9ace" Jul 01 16:09:00.161754 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.161727 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:00.162028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.161854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:00.162028 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.161852 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:09:00.162028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.161912 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:00.162028 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.162001 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:09:00.162244 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.162074 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:09:00.368150 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.368128 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:09:00.368555 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.368525 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" event={"ID":"d6a5676b-37b9-4dc2-aedd-f88738e7d645","Type":"ContainerStarted","Data":"8511f7a46d99340bd449ed811dc28b03c73cf91e96102203d7dd55752f8e995f"} Jul 01 16:09:00.369168 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.368877 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:00.369168 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.368958 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:00.369168 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.369003 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:00.370866 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.370822 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerStarted","Data":"d06c053082fc9bf8521dd3ab07f4627e1ec42e9a6aa6ae9ae6b70f1c6be9a723"} Jul 01 16:09:00.383318 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.383300 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:00.384737 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.384719 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:00.403433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.403396 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" podStartSLOduration=11.576495227 podStartE2EDuration="30.403385097s" totalImagesPullingTime="18.82688987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:00.401392133 +0000 UTC m=+30.600893834" watchObservedRunningTime="2026-07-01 16:09:00.403385097 +0000 UTC m=+30.602886777" Jul 01 16:09:00.439890 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.439827 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfdhs"] Jul 01 16:09:00.439969 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.439938 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:00.440046 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.440028 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:09:00.443049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.443028 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-96fqf"] Jul 01 16:09:00.443156 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.443126 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:00.443267 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.443227 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:09:00.443681 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.443661 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgz6x"] Jul 01 16:09:00.443761 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:00.443750 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:00.443851 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:00.443822 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:09:01.375461 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:01.375192 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="d06c053082fc9bf8521dd3ab07f4627e1ec42e9a6aa6ae9ae6b70f1c6be9a723" exitCode=0 Jul 01 16:09:01.375461 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:01.375267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"d06c053082fc9bf8521dd3ab07f4627e1ec42e9a6aa6ae9ae6b70f1c6be9a723"} Jul 01 16:09:02.160645 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:02.160613 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:02.160774 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:02.160613 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:02.160774 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:02.160726 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:09:02.160869 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:02.160615 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:02.160869 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:02.160784 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:09:02.160941 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:02.160905 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:09:03.382751 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:03.382718 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="7a90fdf143ae5f19a9efd252a63110a6c2a61425fea494b6a445c5bea430d25b" exitCode=0 Jul 01 16:09:03.383258 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:03.382798 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"7a90fdf143ae5f19a9efd252a63110a6c2a61425fea494b6a445c5bea430d25b"} Jul 01 16:09:03.972028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:03.972000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:03.972166 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:03.972034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:03.972166 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:03.972140 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:03.972263 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:03.972190 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret podName:8dad4524-90ec-4f37-99ea-d45a476cb682 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:35.972177105 +0000 UTC m=+66.171678764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret") pod "global-pull-secret-syncer-cfdhs" (UID: "8dad4524-90ec-4f37-99ea-d45a476cb682") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:03.972263 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:03.972140 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:03.972263 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:03.972260 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:09:35.97224802 +0000 UTC m=+66.171749690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:04.073005 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.072978 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:04.073166 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.073103 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:04.073166 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.073118 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:04.073166 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.073127 2583 projected.go:196] Error preparing data for projected volume kube-api-access-z22lc for pod openshift-network-diagnostics/network-check-target-kgz6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:04.073262 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.073170 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc podName:8633ae30-7bfe-4642-80bc-fbce6b8752cb nodeName:}" failed. No retries permitted until 2026-07-01 16:09:36.07315876 +0000 UTC m=+66.272660424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z22lc" (UniqueName: "kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc") pod "network-check-target-kgz6x" (UID: "8633ae30-7bfe-4642-80bc-fbce6b8752cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:04.160946 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.160922 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:04.161106 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.160923 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:04.161106 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.161049 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96fqf" podUID="18f343be-0b67-44db-85a8-ab535755108c" Jul 01 16:09:04.161216 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.160931 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:04.161216 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.161115 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgz6x" podUID="8633ae30-7bfe-4642-80bc-fbce6b8752cb" Jul 01 16:09:04.161216 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.161193 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhs" podUID="8dad4524-90ec-4f37-99ea-d45a476cb682" Jul 01 16:09:04.616695 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.616674 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-101.ec2.internal" event="NodeReady" Jul 01 16:09:04.617198 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.616801 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:09:04.655976 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.655950 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:09:04.658493 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.658468 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.661496 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.661474 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:09:04.661613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.661479 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:09:04.661677 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.661632 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8wwv\"" Jul 01 16:09:04.661900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.661881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:09:04.669512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.669432 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:09:04.670521 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.670503 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sjstk"] Jul 01 16:09:04.672927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.672910 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.676684 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.676667 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ft5w7\"" Jul 01 16:09:04.676773 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.676735 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:09:04.676873 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.676775 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:09:04.680963 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.680945 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:09:04.681508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.681490 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f7p8z"] Jul 01 16:09:04.684062 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.684042 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.687052 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.687034 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:09:04.687160 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.687103 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htp2k\"" Jul 01 16:09:04.687226 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.687186 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:09:04.687285 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.687251 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:09:04.692585 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.692562 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjstk"] Jul 01 16:09:04.697903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.694491 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7p8z"] Jul 01 16:09:04.777684 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777658 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.777918 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777688 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n45rr\" (UniqueName: \"kubernetes.io/projected/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-kube-api-access-n45rr\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.777918 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777710 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbgmm\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.777918 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-config-volume\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.777918 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.777918 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-tmp-dir\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777953 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777978 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.777999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b151564-a85d-4fa0-a038-a5baedad6fd0-cert\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.778025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.778051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.778075 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wl9x\" (UniqueName: \"kubernetes.io/projected/0b151564-a85d-4fa0-a038-a5baedad6fd0-kube-api-access-2wl9x\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.778127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.778234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.778151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879276 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b151564-a85d-4fa0-a038-a5baedad6fd0-cert\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.879276 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879144 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879276 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879276 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wl9x\" (UniqueName: \"kubernetes.io/projected/0b151564-a85d-4fa0-a038-a5baedad6fd0-kube-api-access-2wl9x\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.879456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879284 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.879456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45rr\" (UniqueName: \"kubernetes.io/projected/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-kube-api-access-n45rr\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.879739 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.879666 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:04.879791 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.879738 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:05.379719404 +0000 UTC m=+35.579221075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:04.879791 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.879774 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:04.879927 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.879791 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:04.879927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879823 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.879927 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:04.879865 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:05.379831503 +0000 UTC m=+35.579333177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:04.879927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbgmm\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.880153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-config-volume\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.880153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879966 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.880153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.879983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-tmp-dir\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.880153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.880080 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.880359 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.880297 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-tmp-dir\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.880523 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.880501 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-config-volume\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.880856 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.880819 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.884036 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.883992 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.884036 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.884007 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.884036 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.884016 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b151564-a85d-4fa0-a038-a5baedad6fd0-cert\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.892108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.891793 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.892108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.892057 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n45rr\" (UniqueName: \"kubernetes.io/projected/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-kube-api-access-n45rr\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:04.892694 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.892674 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wl9x\" (UniqueName: \"kubernetes.io/projected/0b151564-a85d-4fa0-a038-a5baedad6fd0-kube-api-access-2wl9x\") pod \"ingress-canary-f7p8z\" (UID: \"0b151564-a85d-4fa0-a038-a5baedad6fd0\") " pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:04.893124 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.893104 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbgmm\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:04.994370 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:04.994208 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7p8z" Jul 01 16:09:05.145450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:05.145366 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7p8z"] Jul 01 16:09:05.149500 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:05.149475 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b151564_a85d_4fa0_a038_a5baedad6fd0.slice/crio-64ce43a4c8b6f1a6730a7dab15af503cb1cf9556412b0efa97b433444448c147 WatchSource:0}: Error finding container 64ce43a4c8b6f1a6730a7dab15af503cb1cf9556412b0efa97b433444448c147: Status 404 returned error can't find the container with id 64ce43a4c8b6f1a6730a7dab15af503cb1cf9556412b0efa97b433444448c147 Jul 01 16:09:05.383722 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:05.383692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:05.383935 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:05.383798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:05.383935 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:05.383867 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:05.383935 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:05.383931 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:06.383915009 +0000 UTC m=+36.583416689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:05.384082 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:05.383946 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:05.384082 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:05.383961 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:05.384082 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:05.384040 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:06.383998635 +0000 UTC m=+36.583500308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:05.389700 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:05.389637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7p8z" event={"ID":"0b151564-a85d-4fa0-a038-a5baedad6fd0","Type":"ContainerStarted","Data":"64ce43a4c8b6f1a6730a7dab15af503cb1cf9556412b0efa97b433444448c147"} Jul 01 16:09:06.161352 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.161320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:06.161352 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.161342 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:06.161981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.161320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:06.164562 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.164541 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:09:06.167164 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.166139 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:09:06.167164 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.166356 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.167164 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.166515 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.167164 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.166722 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:09:06.167164 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.167029 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:09:06.390355 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.390303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:06.390521 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:06.390370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:06.390521 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:06.390481 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:06.390521 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:06.390487 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:06.390521 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:06.390505 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:06.390721 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:06.390548 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.390529551 +0000 UTC m=+38.590031210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:06.390721 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:06.390570 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.390557637 +0000 UTC m=+38.590059304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:08.403831 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:08.403792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:08.403891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:08.403980 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:08.403997 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:08.404001 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:08.404056 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:12.404039391 +0000 UTC m=+42.603541051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:08.404278 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:08.404076 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:12.404066873 +0000 UTC m=+42.603568535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:09.402342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:09.402160 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="e68170fbcb485ee290bc7affbdba1894cbe3125c32920ff07850dd50d2363f02" exitCode=0 Jul 01 16:09:09.402508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:09.402246 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"e68170fbcb485ee290bc7affbdba1894cbe3125c32920ff07850dd50d2363f02"} Jul 01 16:09:09.403956 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:09.403934 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7p8z" event={"ID":"0b151564-a85d-4fa0-a038-a5baedad6fd0","Type":"ContainerStarted","Data":"105af0c5eb9d92c4eda51ba57e3dca2e679a38a24f0be1d269c6754cea61660e"} Jul 01 16:09:09.442648 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:09.442604 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f7p8z" podStartSLOduration=1.9027296 podStartE2EDuration="5.442590699s" totalImagesPullingTime="3.539861099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:09.441765762 +0000 UTC m=+39.641267443" watchObservedRunningTime="2026-07-01 16:09:09.442590699 +0000 UTC m=+39.642092380" Jul 01 16:09:10.409179 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:10.409108 2583 generic.go:356] "Generic (PLEG): container finished" podID="a33db57f-5763-4cff-9728-5dd46e918c7a" containerID="042777b74ac62bc4cd432d28e74d6a141f6af0d837195204abe609ffcca359e3" exitCode=0 Jul 01 16:09:10.409179 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:10.409138 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerDied","Data":"042777b74ac62bc4cd432d28e74d6a141f6af0d837195204abe609ffcca359e3"} Jul 01 16:09:11.415069 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:11.415037 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phgpw" event={"ID":"a33db57f-5763-4cff-9728-5dd46e918c7a","Type":"ContainerStarted","Data":"b3a0b2cc59b18e59ee46c5239fe37b6ebd74fb9d9f3e6ce85ce395f6c6b4e301"} Jul 01 16:09:11.441514 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:11.441468 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-phgpw" podStartSLOduration=10.187518467 podStartE2EDuration="41.441456332s" totalImagesPullingTime="31.253937865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:11.439896967 +0000 UTC m=+41.639398652" watchObservedRunningTime="2026-07-01 16:09:11.441456332 +0000 UTC m=+41.640958012" Jul 01 16:09:12.432287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:12.432254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:12.432355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:12.432366 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:12.432386 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:12.432439 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:20.432423992 +0000 UTC m=+50.631925656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:12.432510 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:12.432686 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:12.432578 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:20.432557649 +0000 UTC m=+50.632059322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:20.480451 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:20.480420 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:20.480489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:20.480564 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:20.480575 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:20.480591 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:20.480620 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:36.480602651 +0000 UTC m=+66.680104320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:20.480892 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:20.480640 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:09:36.480627784 +0000 UTC m=+66.680129444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:32.388573 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:32.388542 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxqk5" Jul 01 16:09:35.982661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:35.982618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:09:35.983155 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:35.982669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:35.985552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:35.985526 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:09:35.985718 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:35.985697 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:09:35.993244 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:35.993220 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:09:35.993339 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:35.993290 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs podName:18f343be-0b67-44db-85a8-ab535755108c nodeName:}" failed. No retries permitted until 2026-07-01 16:10:39.993267611 +0000 UTC m=+130.192769281 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs") pod "network-metrics-daemon-96fqf" (UID: "18f343be-0b67-44db-85a8-ab535755108c") : secret "metrics-daemon-secret" not found Jul 01 16:09:35.997493 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:35.997461 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dad4524-90ec-4f37-99ea-d45a476cb682-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhs\" (UID: \"8dad4524-90ec-4f37-99ea-d45a476cb682\") " pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:36.083481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.083452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:36.086441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.086421 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.096638 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.096619 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.107272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.107245 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22lc\" (UniqueName: \"kubernetes.io/projected/8633ae30-7bfe-4642-80bc-fbce6b8752cb-kube-api-access-z22lc\") pod \"network-check-target-kgz6x\" (UID: \"8633ae30-7bfe-4642-80bc-fbce6b8752cb\") " pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:36.182777 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.182748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhs" Jul 01 16:09:36.191712 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.191692 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:09:36.199541 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.199520 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:36.307979 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.307713 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994"] Jul 01 16:09:36.323072 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.323043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994"] Jul 01 16:09:36.323202 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.323180 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.326083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.326060 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 16:09:36.326205 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.326115 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.326205 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.326129 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6jngv\"" Jul 01 16:09:36.326205 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.326161 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.337444 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.337421 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfdhs"] Jul 01 16:09:36.341227 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:36.341207 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dad4524_90ec_4f37_99ea_d45a476cb682.slice/crio-143bd70463fecbfa5be3f2cd091cae0131ab2f5537ea0b16b77efa219ef57c93 WatchSource:0}: Error finding container 143bd70463fecbfa5be3f2cd091cae0131ab2f5537ea0b16b77efa219ef57c93: Status 404 returned error can't find the container with id 143bd70463fecbfa5be3f2cd091cae0131ab2f5537ea0b16b77efa219ef57c93 Jul 01 16:09:36.351765 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.351746 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgz6x"] Jul 01 16:09:36.354547 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:36.354527 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8633ae30_7bfe_4642_80bc_fbce6b8752cb.slice/crio-a3c341764615cd2aa7587a044aba092d249c22cda40dd6aef449bfa81d263eac WatchSource:0}: Error finding container a3c341764615cd2aa7587a044aba092d249c22cda40dd6aef449bfa81d263eac: Status 404 returned error can't find the container with id a3c341764615cd2aa7587a044aba092d249c22cda40dd6aef449bfa81d263eac Jul 01 16:09:36.391499 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.391479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtln8\" (UniqueName: \"kubernetes.io/projected/8ca4c943-2a1a-4e87-905e-f4c513f8829e-kube-api-access-gtln8\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.391602 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.391557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.412160 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.412138 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrpgx"] Jul 01 16:09:36.414377 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.414363 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" Jul 01 16:09:36.418290 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.418272 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h22g9\"" Jul 01 16:09:36.420407 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.420390 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p"] Jul 01 16:09:36.422283 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.422268 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.423543 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.423527 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-zc2vd"] Jul 01 16:09:36.425537 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.425522 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.431314 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431243 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 16:09:36.431314 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431255 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ng59r\"" Jul 01 16:09:36.431314 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431281 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 16:09:36.431314 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431309 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rm8jx\"" Jul 01 16:09:36.431566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431347 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 16:09:36.431566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431281 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.431566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431255 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.431566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431258 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.431566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431251 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.431799 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.431647 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 16:09:36.470291 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.470263 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfdhs" event={"ID":"8dad4524-90ec-4f37-99ea-d45a476cb682","Type":"ContainerStarted","Data":"143bd70463fecbfa5be3f2cd091cae0131ab2f5537ea0b16b77efa219ef57c93"} Jul 01 16:09:36.471265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.471245 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgz6x" event={"ID":"8633ae30-7bfe-4642-80bc-fbce6b8752cb","Type":"ContainerStarted","Data":"a3c341764615cd2aa7587a044aba092d249c22cda40dd6aef449bfa81d263eac"} Jul 01 16:09:36.492541 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492495 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11353c03-1887-4f6d-b25e-a4d81008696b-serving-cert\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.492541 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f39d12dc-383b-4510-b00a-96b81ad13b9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.492639 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:09:36.492639 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.492702 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.492646 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:36.492702 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.492688 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls podName:2e0c2c09-827b-43c7-b72f-b7dcbacb2597 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.492672467 +0000 UTC m=+98.692174140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls") pod "dns-default-sjstk" (UID: "2e0c2c09-827b-43c7-b72f-b7dcbacb2597") : secret "dns-default-metrics-tls" not found Jul 01 16:09:36.492702 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.492689 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:09:36.492797 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-trusted-ca\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.492797 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.492727 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls podName:8ca4c943-2a1a-4e87-905e-f4c513f8829e nodeName:}" failed. No retries permitted until 2026-07-01 16:09:36.992716617 +0000 UTC m=+67.192218276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-jr994" (UID: "8ca4c943-2a1a-4e87-905e-f4c513f8829e") : secret "samples-operator-tls" not found Jul 01 16:09:36.492797 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ctqx\" (UniqueName: \"kubernetes.io/projected/ba213b19-9cb1-4abb-8758-bf9eee740b82-kube-api-access-2ctqx\") pod \"network-check-source-56499946bc-qrpgx\" (UID: \"ba213b19-9cb1-4abb-8758-bf9eee740b82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" Jul 01 16:09:36.492797 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-config\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.492797 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492795 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdgbg\" (UniqueName: \"kubernetes.io/projected/11353c03-1887-4f6d-b25e-a4d81008696b-kube-api-access-jdgbg\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t44zr\" (UniqueName: \"kubernetes.io/projected/f39d12dc-383b-4510-b00a-96b81ad13b9d-kube-api-access-t44zr\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtln8\" (UniqueName: \"kubernetes.io/projected/8ca4c943-2a1a-4e87-905e-f4c513f8829e-kube-api-access-gtln8\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.492976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.493049 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:36.493063 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.493059 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b454f7ddc-tmbm5: secret "image-registry-tls" not found Jul 01 16:09:36.493327 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.493098 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls podName:fe2162a5-f94b-4d70-ae1e-ae3e755df7de nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.493085307 +0000 UTC m=+98.692587001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls") pod "image-registry-5b454f7ddc-tmbm5" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de") : secret "image-registry-tls" not found Jul 01 16:09:36.528358 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.528337 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p"] Jul 01 16:09:36.574051 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.574030 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtln8\" (UniqueName: \"kubernetes.io/projected/8ca4c943-2a1a-4e87-905e-f4c513f8829e-kube-api-access-gtln8\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.593547 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-trusted-ca\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.593642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ctqx\" (UniqueName: \"kubernetes.io/projected/ba213b19-9cb1-4abb-8758-bf9eee740b82-kube-api-access-2ctqx\") pod \"network-check-source-56499946bc-qrpgx\" (UID: \"ba213b19-9cb1-4abb-8758-bf9eee740b82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" Jul 01 16:09:36.593642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593589 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-config\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.593642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdgbg\" (UniqueName: \"kubernetes.io/projected/11353c03-1887-4f6d-b25e-a4d81008696b-kube-api-access-jdgbg\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.593802 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t44zr\" (UniqueName: \"kubernetes.io/projected/f39d12dc-383b-4510-b00a-96b81ad13b9d-kube-api-access-t44zr\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.593802 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.593802 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.593761 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:36.593802 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.593800 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.093785611 +0000 UTC m=+67.293287272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:36.594066 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11353c03-1887-4f6d-b25e-a4d81008696b-serving-cert\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.594066 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.593881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f39d12dc-383b-4510-b00a-96b81ad13b9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.594396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.594362 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-config\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.594626 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.594604 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f39d12dc-383b-4510-b00a-96b81ad13b9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.596337 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.596318 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11353c03-1887-4f6d-b25e-a4d81008696b-serving-cert\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.597113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.597097 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-zc2vd"] Jul 01 16:09:36.634782 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.634753 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 16:09:36.641965 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.641944 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ctqx\" (UniqueName: \"kubernetes.io/projected/ba213b19-9cb1-4abb-8758-bf9eee740b82-kube-api-access-2ctqx\") pod \"network-check-source-56499946bc-qrpgx\" (UID: \"ba213b19-9cb1-4abb-8758-bf9eee740b82\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" Jul 01 16:09:36.642914 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.642895 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdgbg\" (UniqueName: \"kubernetes.io/projected/11353c03-1887-4f6d-b25e-a4d81008696b-kube-api-access-jdgbg\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.645817 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.645794 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11353c03-1887-4f6d-b25e-a4d81008696b-trusted-ca\") pod \"console-operator-7fdbdf9c99-zc2vd\" (UID: \"11353c03-1887-4f6d-b25e-a4d81008696b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.648476 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.648452 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t44zr\" (UniqueName: \"kubernetes.io/projected/f39d12dc-383b-4510-b00a-96b81ad13b9d-kube-api-access-t44zr\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:36.677568 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.677541 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrpgx"] Jul 01 16:09:36.714810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.714788 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2"] Jul 01 16:09:36.718025 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.718011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.721166 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721146 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 16:09:36.721421 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721406 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.721794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721780 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.721794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721787 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 16:09:36.721975 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721955 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b6b4v\"" Jul 01 16:09:36.722043 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.721972 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" Jul 01 16:09:36.732878 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.732857 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2"] Jul 01 16:09:36.735458 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.735442 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:36.795687 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.795605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5f02da-b908-477b-90fd-6c5d6b16452d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.795906 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.795885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e5f02da-b908-477b-90fd-6c5d6b16452d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.796121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.796104 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6lv\" (UniqueName: \"kubernetes.io/projected/6e5f02da-b908-477b-90fd-6c5d6b16452d-kube-api-access-vf6lv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.850680 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.850656 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrpgx"] Jul 01 16:09:36.852761 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:36.852729 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba213b19_9cb1_4abb_8758_bf9eee740b82.slice/crio-1f250576ae505759551770dc0895dc772e403ed4a8ae06b1e039d9905b41743b WatchSource:0}: Error finding container 1f250576ae505759551770dc0895dc772e403ed4a8ae06b1e039d9905b41743b: Status 404 returned error can't find the container with id 1f250576ae505759551770dc0895dc772e403ed4a8ae06b1e039d9905b41743b Jul 01 16:09:36.866865 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.866824 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-zc2vd"] Jul 01 16:09:36.869833 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:36.869807 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11353c03_1887_4f6d_b25e_a4d81008696b.slice/crio-364e6f90c8a2355997433399f4b06ea94d37dd5e89cb8e1b4186578c923021d9 WatchSource:0}: Error finding container 364e6f90c8a2355997433399f4b06ea94d37dd5e89cb8e1b4186578c923021d9: Status 404 returned error can't find the container with id 364e6f90c8a2355997433399f4b06ea94d37dd5e89cb8e1b4186578c923021d9 Jul 01 16:09:36.897687 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.897662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6lv\" (UniqueName: \"kubernetes.io/projected/6e5f02da-b908-477b-90fd-6c5d6b16452d-kube-api-access-vf6lv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.897810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.897795 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5f02da-b908-477b-90fd-6c5d6b16452d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.897960 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.897823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e5f02da-b908-477b-90fd-6c5d6b16452d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.898481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.898461 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e5f02da-b908-477b-90fd-6c5d6b16452d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.900143 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.900120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5f02da-b908-477b-90fd-6c5d6b16452d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.911372 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.911349 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6lv\" (UniqueName: \"kubernetes.io/projected/6e5f02da-b908-477b-90fd-6c5d6b16452d-kube-api-access-vf6lv\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2hqh2\" (UID: \"6e5f02da-b908-477b-90fd-6c5d6b16452d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:36.998741 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:36.998676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:36.999136 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.998859 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:09:36.999136 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:36.998923 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls podName:8ca4c943-2a1a-4e87-905e-f4c513f8829e nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.998906267 +0000 UTC m=+68.198407929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-jr994" (UID: "8ca4c943-2a1a-4e87-905e-f4c513f8829e") : secret "samples-operator-tls" not found Jul 01 16:09:37.026943 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.026919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" Jul 01 16:09:37.099765 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.099730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:37.099969 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:37.099948 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:37.100057 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:37.100039 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.100018942 +0000 UTC m=+68.299520605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:37.171774 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.171707 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2"] Jul 01 16:09:37.175326 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:09:37.175296 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5f02da_b908_477b_90fd_6c5d6b16452d.slice/crio-feac5aeab1a41214d052cf1257e73a4f4dfb9430e5ed78c658a7125d4e909f1d WatchSource:0}: Error finding container feac5aeab1a41214d052cf1257e73a4f4dfb9430e5ed78c658a7125d4e909f1d: Status 404 returned error can't find the container with id feac5aeab1a41214d052cf1257e73a4f4dfb9430e5ed78c658a7125d4e909f1d Jul 01 16:09:37.476822 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.476783 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" event={"ID":"11353c03-1887-4f6d-b25e-a4d81008696b","Type":"ContainerStarted","Data":"364e6f90c8a2355997433399f4b06ea94d37dd5e89cb8e1b4186578c923021d9"} Jul 01 16:09:37.478522 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.478450 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" event={"ID":"ba213b19-9cb1-4abb-8758-bf9eee740b82","Type":"ContainerStarted","Data":"1f250576ae505759551770dc0895dc772e403ed4a8ae06b1e039d9905b41743b"} Jul 01 16:09:37.480015 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:37.479958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" event={"ID":"6e5f02da-b908-477b-90fd-6c5d6b16452d","Type":"ContainerStarted","Data":"feac5aeab1a41214d052cf1257e73a4f4dfb9430e5ed78c658a7125d4e909f1d"} Jul 01 16:09:38.007723 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:38.007687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:38.008241 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:38.007905 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:09:38.008241 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:38.007970 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls podName:8ca4c943-2a1a-4e87-905e-f4c513f8829e nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.007951617 +0000 UTC m=+70.207453278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-jr994" (UID: "8ca4c943-2a1a-4e87-905e-f4c513f8829e") : secret "samples-operator-tls" not found Jul 01 16:09:38.108471 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:38.108426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:38.108692 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:38.108673 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:38.108778 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:38.108738 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.108720754 +0000 UTC m=+70.308222429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:40.026696 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:40.026652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:40.027188 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:40.026865 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:09:40.027188 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:40.026949 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls podName:8ca4c943-2a1a-4e87-905e-f4c513f8829e nodeName:}" failed. No retries permitted until 2026-07-01 16:09:44.026927549 +0000 UTC m=+74.226429221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-jr994" (UID: "8ca4c943-2a1a-4e87-905e-f4c513f8829e") : secret "samples-operator-tls" not found Jul 01 16:09:40.127624 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:40.127592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:40.127746 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:40.127701 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:40.127786 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:40.127750 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:09:44.127738215 +0000 UTC m=+74.327239874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:41.944275 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.944241 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4sxwx"] Jul 01 16:09:41.947754 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.947722 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:41.950762 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.950733 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:09:41.950762 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.950739 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:09:41.950984 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.950804 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dd5dp\"" Jul 01 16:09:41.952492 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.952471 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:09:41.952622 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.952532 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:09:41.961568 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:41.961499 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4sxwx"] Jul 01 16:09:42.044945 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.044919 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e086c724-48fe-493d-b5db-98c9cf270913-crio-socket\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.045096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.044956 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e086c724-48fe-493d-b5db-98c9cf270913-data-volume\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.045096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.045085 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.045214 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.045142 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.045214 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.045197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frcf9\" (UniqueName: \"kubernetes.io/projected/e086c724-48fe-493d-b5db-98c9cf270913-kube-api-access-frcf9\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.145696 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.145661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.145869 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.145722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.145869 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.145772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frcf9\" (UniqueName: \"kubernetes.io/projected/e086c724-48fe-493d-b5db-98c9cf270913-kube-api-access-frcf9\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.145869 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.145828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e086c724-48fe-493d-b5db-98c9cf270913-crio-socket\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.145869 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.145833 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.146096 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.145899 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.146096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.145930 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e086c724-48fe-493d-b5db-98c9cf270913-crio-socket\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.146096 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.145937 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.645914769 +0000 UTC m=+72.845416445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.146096 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.145964 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.645947737 +0000 UTC m=+72.845449419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.146096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.146031 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e086c724-48fe-493d-b5db-98c9cf270913-data-volume\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.146426 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.146406 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e086c724-48fe-493d-b5db-98c9cf270913-data-volume\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.154197 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.154177 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frcf9\" (UniqueName: \"kubernetes.io/projected/e086c724-48fe-493d-b5db-98c9cf270913-kube-api-access-frcf9\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.650120 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.650088 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.650226 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:42.650151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:42.650290 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.650250 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.650349 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.650305 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.650286924 +0000 UTC m=+73.849788585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.650689 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.650662 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.650781 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:42.650758 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.650740254 +0000 UTC m=+73.850241916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.500357 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.500325 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfdhs" event={"ID":"8dad4524-90ec-4f37-99ea-d45a476cb682","Type":"ContainerStarted","Data":"da584493563fef8b392056c7c0611309d5e7a90a1b8ab940e43a0424ae5d0231"} Jul 01 16:09:43.501970 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.501951 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/0.log" Jul 01 16:09:43.502079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.501985 2583 generic.go:356] "Generic (PLEG): container finished" podID="11353c03-1887-4f6d-b25e-a4d81008696b" containerID="a71e8a6040466408d88538b778cf32bf05831a6cfa3851b137b464a45b1427e4" exitCode=255 Jul 01 16:09:43.502079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.502042 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" event={"ID":"11353c03-1887-4f6d-b25e-a4d81008696b","Type":"ContainerDied","Data":"a71e8a6040466408d88538b778cf32bf05831a6cfa3851b137b464a45b1427e4"} Jul 01 16:09:43.502266 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.502249 2583 scope.go:117] "RemoveContainer" containerID="a71e8a6040466408d88538b778cf32bf05831a6cfa3851b137b464a45b1427e4" Jul 01 16:09:43.503762 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.503739 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" event={"ID":"ba213b19-9cb1-4abb-8758-bf9eee740b82","Type":"ContainerStarted","Data":"57d5126a0b6fd4d9f3738346eeff7e0155f447b87f3416d4583e8701807f1492"} Jul 01 16:09:43.505293 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.505248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" event={"ID":"6e5f02da-b908-477b-90fd-6c5d6b16452d","Type":"ContainerStarted","Data":"2f5b6d104261abcd2d9f7e054874706e69abb96c885f4d88eb97d9d82d106307"} Jul 01 16:09:43.506792 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.506771 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgz6x" event={"ID":"8633ae30-7bfe-4642-80bc-fbce6b8752cb","Type":"ContainerStarted","Data":"37f14bdea01966c95ae117dfe85717961390b46c1b0afbed100be8f5ddc26de0"} Jul 01 16:09:43.506911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.506898 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:09:43.523095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.523049 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfdhs" podStartSLOduration=67.28092073 podStartE2EDuration="1m13.523035103s" totalImagesPullingTime="6.242114373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.522237146 +0000 UTC m=+73.721738828" watchObservedRunningTime="2026-07-01 16:09:43.523035103 +0000 UTC m=+73.722536787" Jul 01 16:09:43.537330 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.537289 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrpgx" podStartSLOduration=1.822880455 podStartE2EDuration="7.537272421s" totalImagesPullingTime="5.714391966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.536787097 +0000 UTC m=+73.736288782" watchObservedRunningTime="2026-07-01 16:09:43.537272421 +0000 UTC m=+73.736774104" Jul 01 16:09:43.566607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.566562 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" podStartSLOduration=2.17419256 podStartE2EDuration="7.566544023s" totalImagesPullingTime="5.392351463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.565784491 +0000 UTC m=+73.765286171" watchObservedRunningTime="2026-07-01 16:09:43.566544023 +0000 UTC m=+73.766045706" Jul 01 16:09:43.615123 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.615066 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgz6x" podStartSLOduration=67.406319896 podStartE2EDuration="1m13.615044966s" totalImagesPullingTime="6.20872507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.612071759 +0000 UTC m=+73.811573442" watchObservedRunningTime="2026-07-01 16:09:43.615044966 +0000 UTC m=+73.814546648" Jul 01 16:09:43.659733 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.659697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:43.659865 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.659794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:43.660727 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:43.660349 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.660727 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:43.660415 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.660397149 +0000 UTC m=+75.859898810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.660727 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:43.660543 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:43.660727 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:43.660606 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.660590506 +0000 UTC m=+75.860092172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : configmap "kube-rbac-proxy" not found Jul 01 16:09:43.744674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:43.744648 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lp54_24162509-d5ad-4c93-884a-b2be4b44c6ef/dns-node-resolver/0.log" Jul 01 16:09:44.063382 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.063351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:44.063547 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:44.063519 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:09:44.063600 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:44.063588 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls podName:8ca4c943-2a1a-4e87-905e-f4c513f8829e nodeName:}" failed. No retries permitted until 2026-07-01 16:09:52.063572625 +0000 UTC m=+82.263074287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-jr994" (UID: "8ca4c943-2a1a-4e87-905e-f4c513f8829e") : secret "samples-operator-tls" not found Jul 01 16:09:44.163890 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.163853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:44.164040 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:44.163948 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:44.164040 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:44.164005 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:09:52.163990986 +0000 UTC m=+82.363492649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:44.512225 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.512201 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/1.log" Jul 01 16:09:44.512631 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.512615 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/0.log" Jul 01 16:09:44.512674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.512650 2583 generic.go:356] "Generic (PLEG): container finished" podID="11353c03-1887-4f6d-b25e-a4d81008696b" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" exitCode=255 Jul 01 16:09:44.512773 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.512745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" event={"ID":"11353c03-1887-4f6d-b25e-a4d81008696b","Type":"ContainerDied","Data":"2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc"} Jul 01 16:09:44.512825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.512813 2583 scope.go:117] "RemoveContainer" containerID="a71e8a6040466408d88538b778cf32bf05831a6cfa3851b137b464a45b1427e4" Jul 01 16:09:44.513061 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:44.513028 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:09:44.513226 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:44.513204 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:09:45.143974 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.143950 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-snb6k_63b5239a-337a-4117-9c86-1cc825a23789/node-ca/0.log" Jul 01 16:09:45.519821 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.519796 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/1.log" Jul 01 16:09:45.520153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.520134 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:09:45.520317 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:45.520291 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:09:45.674390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.674355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:45.674513 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.674419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:45.674581 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:45.674542 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.674581 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:45.674562 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:45.674683 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:45.674630 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.674609239 +0000 UTC m=+79.874110900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.674683 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:45.674657 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.674644355 +0000 UTC m=+79.874146015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : configmap "kube-rbac-proxy" not found Jul 01 16:09:45.944963 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:45.944875 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f7p8z_0b151564-a85d-4fa0-a038-a5baedad6fd0/serve-healthcheck-canary/0.log" Jul 01 16:09:46.736345 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:46.736314 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:46.736768 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:46.736406 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:09:46.736768 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:46.736760 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:09:46.737022 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:46.736995 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:09:47.527492 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:47.527468 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:09:47.527622 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:47.527603 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:09:49.704589 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:49.704547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:49.704589 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:49.704605 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:49.705077 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:49.704672 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:49.705077 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:49.704708 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:49.705077 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:49.704726 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.704712453 +0000 UTC m=+87.904214116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : configmap "kube-rbac-proxy" not found Jul 01 16:09:49.705077 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:49.704769 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.704754182 +0000 UTC m=+87.904255841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:52.122893 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.122834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:52.125378 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.125340 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ca4c943-2a1a-4e87-905e-f4c513f8829e-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-jr994\" (UID: \"8ca4c943-2a1a-4e87-905e-f4c513f8829e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:52.223379 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.223279 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:09:52.223479 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:52.223391 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:52.223479 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:52.223463 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls podName:f39d12dc-383b-4510-b00a-96b81ad13b9d nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.223446248 +0000 UTC m=+98.422947912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-tsm5p" (UID: "f39d12dc-383b-4510-b00a-96b81ad13b9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:09:52.232159 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.232135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" Jul 01 16:09:52.358192 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.358168 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994"] Jul 01 16:09:52.543785 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:52.543753 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" event={"ID":"8ca4c943-2a1a-4e87-905e-f4c513f8829e","Type":"ContainerStarted","Data":"3f04a25bcb7f4eec318fc69759aa42cc4307c6bf81e2825002285f2837c8fe58"} Jul 01 16:09:55.554277 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:55.554242 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" event={"ID":"8ca4c943-2a1a-4e87-905e-f4c513f8829e","Type":"ContainerStarted","Data":"dfc3df2afc70a68d8ee74280537179258458694c5e56f6a08ab80c93827f9ec7"} Jul 01 16:09:55.554657 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:55.554326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" event={"ID":"8ca4c943-2a1a-4e87-905e-f4c513f8829e","Type":"ContainerStarted","Data":"d38e07048d8bdcab9d0279cd3fa864982c2069a8e813ac2b85afcfdf59a0c646"} Jul 01 16:09:55.572692 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:55.572643 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-jr994" podStartSLOduration=16.860735956 podStartE2EDuration="19.572629429s" totalImagesPullingTime="2.711893473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:55.572165204 +0000 UTC m=+85.771666886" watchObservedRunningTime="2026-07-01 16:09:55.572629429 +0000 UTC m=+85.772131088" Jul 01 16:09:57.767479 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:57.767442 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:57.767912 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:57.767554 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:09:57.767912 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:57.767679 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.767912 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:09:57.767750 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls podName:e086c724-48fe-493d-b5db-98c9cf270913 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:13.767730358 +0000 UTC m=+103.967232021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sxwx" (UID: "e086c724-48fe-493d-b5db-98c9cf270913") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.768211 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:09:57.768189 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e086c724-48fe-493d-b5db-98c9cf270913-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:10:03.006908 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.006872 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w"] Jul 01 16:10:03.010097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.010077 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.017735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.017708 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 16:10:03.017900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.017715 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 16:10:03.017900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.017768 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 16:10:03.017900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.017768 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8672d\"" Jul 01 16:10:03.017900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.017895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 16:10:03.025280 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.025255 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w"] Jul 01 16:10:03.105741 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.105716 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbl9c\" (UniqueName: \"kubernetes.io/projected/6df56d89-e299-4600-a778-552027457f70-kube-api-access-bbl9c\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.105862 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.105801 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df56d89-e299-4600-a778-552027457f70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.160976 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.160949 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:10:03.206180 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.206158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df56d89-e299-4600-a778-552027457f70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.206259 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.206218 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbl9c\" (UniqueName: \"kubernetes.io/projected/6df56d89-e299-4600-a778-552027457f70-kube-api-access-bbl9c\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.208486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.208457 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6df56d89-e299-4600-a778-552027457f70-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.214832 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.214814 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbl9c\" (UniqueName: \"kubernetes.io/projected/6df56d89-e299-4600-a778-552027457f70-kube-api-access-bbl9c\") pod \"managed-serviceaccount-addon-agent-5b8666655b-jgg8w\" (UID: \"6df56d89-e299-4600-a778-552027457f70\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.331575 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.331549 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" Jul 01 16:10:03.454940 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.454915 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w"] Jul 01 16:10:03.457640 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:03.457614 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6df56d89_e299_4600_a778_552027457f70.slice/crio-278770b4e2e1177355647e6bcde7b55699495c82be9e53294e63e0c6e081d972 WatchSource:0}: Error finding container 278770b4e2e1177355647e6bcde7b55699495c82be9e53294e63e0c6e081d972: Status 404 returned error can't find the container with id 278770b4e2e1177355647e6bcde7b55699495c82be9e53294e63e0c6e081d972 Jul 01 16:10:03.579243 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.579182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" event={"ID":"6df56d89-e299-4600-a778-552027457f70","Type":"ContainerStarted","Data":"278770b4e2e1177355647e6bcde7b55699495c82be9e53294e63e0c6e081d972"} Jul 01 16:10:03.580539 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.580521 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:10:03.580954 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.580938 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/1.log" Jul 01 16:10:03.581016 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.580972 2583 generic.go:356] "Generic (PLEG): container finished" podID="11353c03-1887-4f6d-b25e-a4d81008696b" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" exitCode=255 Jul 01 16:10:03.581016 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.581001 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" event={"ID":"11353c03-1887-4f6d-b25e-a4d81008696b","Type":"ContainerDied","Data":"2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758"} Jul 01 16:10:03.581093 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.581036 2583 scope.go:117] "RemoveContainer" containerID="2d66053403c4c0dbbc84e47a247303781e2d7e17a79a6a04a1e881098cb9d7bc" Jul 01 16:10:03.581338 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:03.581320 2583 scope.go:117] "RemoveContainer" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" Jul 01 16:10:03.581490 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:03.581470 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:10:04.586599 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:04.586573 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:10:06.600667 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:06.600637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" event={"ID":"6df56d89-e299-4600-a778-552027457f70","Type":"ContainerStarted","Data":"da1f617369905b2f9b733e9924d766ab154180e40cb0e69699eab48d831c832b"} Jul 01 16:10:06.620293 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:06.620252 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8666655b-jgg8w" podStartSLOduration=1.5829785969999999 podStartE2EDuration="4.62023775s" totalImagesPullingTime="3.037259153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:06.619706241 +0000 UTC m=+96.819207922" watchObservedRunningTime="2026-07-01 16:10:06.62023775 +0000 UTC m=+96.819739431" Jul 01 16:10:06.736484 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:06.736462 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:10:06.736577 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:06.736503 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:10:06.736752 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:06.736736 2583 scope.go:117] "RemoveContainer" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" Jul 01 16:10:06.736929 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:06.736907 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:10:07.604618 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:07.604592 2583 scope.go:117] "RemoveContainer" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" Jul 01 16:10:07.605012 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:07.604737 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:10:08.241816 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.241778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:10:08.244328 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.244295 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39d12dc-383b-4510-b00a-96b81ad13b9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-tsm5p\" (UID: \"f39d12dc-383b-4510-b00a-96b81ad13b9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:10:08.530537 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.530473 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" Jul 01 16:10:08.544551 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.544524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:08.544665 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.544564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:10:08.546812 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.546778 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0c2c09-827b-43c7-b72f-b7dcbacb2597-metrics-tls\") pod \"dns-default-sjstk\" (UID: \"2e0c2c09-827b-43c7-b72f-b7dcbacb2597\") " pod="openshift-dns/dns-default-sjstk" Jul 01 16:10:08.547640 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.547607 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"image-registry-5b454f7ddc-tmbm5\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:08.573905 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.573863 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8wwv\"" Jul 01 16:10:08.581648 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.581624 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:08.586024 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.586007 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ft5w7\"" Jul 01 16:10:08.593708 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.593682 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjstk" Jul 01 16:10:08.682482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.682455 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p"] Jul 01 16:10:08.685221 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:08.685198 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39d12dc_383b_4510_b00a_96b81ad13b9d.slice/crio-96ccea1eb3e44728355be7fec6ec67575a4c50018643b3f3b7e087ae27c6feb6 WatchSource:0}: Error finding container 96ccea1eb3e44728355be7fec6ec67575a4c50018643b3f3b7e087ae27c6feb6: Status 404 returned error can't find the container with id 96ccea1eb3e44728355be7fec6ec67575a4c50018643b3f3b7e087ae27c6feb6 Jul 01 16:10:08.730363 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.730342 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:10:08.732093 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:08.732062 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2162a5_f94b_4d70_ae1e_ae3e755df7de.slice/crio-a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1 WatchSource:0}: Error finding container a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1: Status 404 returned error can't find the container with id a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1 Jul 01 16:10:08.743219 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:08.743198 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjstk"] Jul 01 16:10:08.745151 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:08.745129 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0c2c09_827b_43c7_b72f_b7dcbacb2597.slice/crio-7513a8be0d690ba36b53db62eb34e775772e356d72913745d796d8e682ee732c WatchSource:0}: Error finding container 7513a8be0d690ba36b53db62eb34e775772e356d72913745d796d8e682ee732c: Status 404 returned error can't find the container with id 7513a8be0d690ba36b53db62eb34e775772e356d72913745d796d8e682ee732c Jul 01 16:10:09.615329 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.615293 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjstk" event={"ID":"2e0c2c09-827b-43c7-b72f-b7dcbacb2597","Type":"ContainerStarted","Data":"7513a8be0d690ba36b53db62eb34e775772e356d72913745d796d8e682ee732c"} Jul 01 16:10:09.616605 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.616573 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" event={"ID":"f39d12dc-383b-4510-b00a-96b81ad13b9d","Type":"ContainerStarted","Data":"96ccea1eb3e44728355be7fec6ec67575a4c50018643b3f3b7e087ae27c6feb6"} Jul 01 16:10:09.618324 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.618293 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" event={"ID":"fe2162a5-f94b-4d70-ae1e-ae3e755df7de","Type":"ContainerStarted","Data":"2dbb5b51ef3d4511c1405b7377a686467cbc471c24cb4f0dc4a382eef1a94b4a"} Jul 01 16:10:09.618453 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.618340 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" event={"ID":"fe2162a5-f94b-4d70-ae1e-ae3e755df7de","Type":"ContainerStarted","Data":"a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1"} Jul 01 16:10:09.618453 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.618421 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:09.642589 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:09.642536 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" podStartSLOduration=99.64252107 podStartE2EDuration="1m39.64252107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:09.640280378 +0000 UTC m=+99.839782061" watchObservedRunningTime="2026-07-01 16:10:09.64252107 +0000 UTC m=+99.842022752" Jul 01 16:10:11.509029 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.508999 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc"] Jul 01 16:10:11.514212 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.514194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:11.517074 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.517051 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 16:10:11.517168 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.517057 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l4wwz\"" Jul 01 16:10:11.524765 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.524741 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc"] Jul 01 16:10:11.628844 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.628818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjstk" event={"ID":"2e0c2c09-827b-43c7-b72f-b7dcbacb2597","Type":"ContainerStarted","Data":"af80e63413fded89eb9d7b5c17c1c63656ee07ca8c3ce77237388c4bbb730f6c"} Jul 01 16:10:11.628922 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.628872 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjstk" event={"ID":"2e0c2c09-827b-43c7-b72f-b7dcbacb2597","Type":"ContainerStarted","Data":"dff05eb413f609cef5180c2fb2a73aa44895238b5fa14245a16c6dc47f70e0db"} Jul 01 16:10:11.628984 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.628942 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sjstk" Jul 01 16:10:11.630356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.630335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" event={"ID":"f39d12dc-383b-4510-b00a-96b81ad13b9d","Type":"ContainerStarted","Data":"f298bfbec287aae5bfa75591be9e18cb64b74fba2061fc5ae077996d1fd67fdb"} Jul 01 16:10:11.659983 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.659943 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sjstk" podStartSLOduration=65.427503036 podStartE2EDuration="1m7.65992974s" totalImagesPullingTime="2.232426704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:11.659267021 +0000 UTC m=+101.858768702" watchObservedRunningTime="2026-07-01 16:10:11.65992974 +0000 UTC m=+101.859431438" Jul 01 16:10:11.670613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.670593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-klzfc\" (UID: \"c77f816a-5ecb-46a5-81ed-837b67d7dbf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:11.697320 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.697285 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-tsm5p" podStartSLOduration=33.408570741 podStartE2EDuration="35.697273183s" totalImagesPullingTime="2.288702442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:11.697133862 +0000 UTC m=+101.896635544" watchObservedRunningTime="2026-07-01 16:10:11.697273183 +0000 UTC m=+101.896774858" Jul 01 16:10:11.771580 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:11.771525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-klzfc\" (UID: \"c77f816a-5ecb-46a5-81ed-837b67d7dbf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:11.771725 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:11.771654 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 16:10:11.771725 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:11.771706 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates podName:c77f816a-5ecb-46a5-81ed-837b67d7dbf3 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:12.271693078 +0000 UTC m=+102.471194737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-klzfc" (UID: "c77f816a-5ecb-46a5-81ed-837b67d7dbf3") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 16:10:12.275354 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:12.275334 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-klzfc\" (UID: \"c77f816a-5ecb-46a5-81ed-837b67d7dbf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:12.277682 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:12.277658 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c77f816a-5ecb-46a5-81ed-837b67d7dbf3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-klzfc\" (UID: \"c77f816a-5ecb-46a5-81ed-837b67d7dbf3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:12.422264 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:12.422243 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:12.583033 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:12.583008 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc"] Jul 01 16:10:12.585073 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:12.585038 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77f816a_5ecb_46a5_81ed_837b67d7dbf3.slice/crio-d3029bd20142d31a16f309f4d49fa7ce2419db439e5803606d7707c5396bc858 WatchSource:0}: Error finding container d3029bd20142d31a16f309f4d49fa7ce2419db439e5803606d7707c5396bc858: Status 404 returned error can't find the container with id d3029bd20142d31a16f309f4d49fa7ce2419db439e5803606d7707c5396bc858 Jul 01 16:10:12.634343 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:12.634313 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" event={"ID":"c77f816a-5ecb-46a5-81ed-837b67d7dbf3","Type":"ContainerStarted","Data":"d3029bd20142d31a16f309f4d49fa7ce2419db439e5803606d7707c5396bc858"} Jul 01 16:10:13.787580 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:13.787551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:10:13.790141 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:13.790115 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e086c724-48fe-493d-b5db-98c9cf270913-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sxwx\" (UID: \"e086c724-48fe-493d-b5db-98c9cf270913\") " pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:10:14.059865 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.059793 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4sxwx" Jul 01 16:10:14.335615 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.335591 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4sxwx"] Jul 01 16:10:14.337131 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:14.337106 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode086c724_48fe_493d_b5db_98c9cf270913.slice/crio-f451704db54492a9fd7cceb170af7c58a83c1dbc5dbacde8a995c90956865022 WatchSource:0}: Error finding container f451704db54492a9fd7cceb170af7c58a83c1dbc5dbacde8a995c90956865022: Status 404 returned error can't find the container with id f451704db54492a9fd7cceb170af7c58a83c1dbc5dbacde8a995c90956865022 Jul 01 16:10:14.515435 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.515413 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgz6x" Jul 01 16:10:14.642396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.642336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sxwx" event={"ID":"e086c724-48fe-493d-b5db-98c9cf270913","Type":"ContainerStarted","Data":"f451704db54492a9fd7cceb170af7c58a83c1dbc5dbacde8a995c90956865022"} Jul 01 16:10:14.643863 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.643825 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" event={"ID":"c77f816a-5ecb-46a5-81ed-837b67d7dbf3","Type":"ContainerStarted","Data":"6119fcc6c2ebb1012d61bb0ef202d4ab1bd8aa1cd8595ac5d92ca2ad94c6718e"} Jul 01 16:10:14.644064 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.644036 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:14.648629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.648609 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" Jul 01 16:10:14.661469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:14.661423 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-klzfc" podStartSLOduration=2.028339843 podStartE2EDuration="3.661411089s" totalImagesPullingTime="1.633071246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:14.660812449 +0000 UTC m=+104.860314131" watchObservedRunningTime="2026-07-01 16:10:14.661411089 +0000 UTC m=+104.860912769" Jul 01 16:10:18.161286 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:18.161257 2583 scope.go:117] "RemoveContainer" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" Jul 01 16:10:18.161763 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:18.161451 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-zc2vd_openshift-console-operator(11353c03-1887-4f6d-b25e-a4d81008696b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podUID="11353c03-1887-4f6d-b25e-a4d81008696b" Jul 01 16:10:18.660662 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:18.660633 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sxwx" event={"ID":"e086c724-48fe-493d-b5db-98c9cf270913","Type":"ContainerStarted","Data":"6ddc9e71946a1141819f32b5f3ebf6865608fbdf91a195e32ade4f04ce45cd0b"} Jul 01 16:10:19.667103 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:19.667066 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sxwx" event={"ID":"e086c724-48fe-493d-b5db-98c9cf270913","Type":"ContainerStarted","Data":"2a3b04c86a085b05b77a816461f264e1cafd5fdbdb8721a720034e69a2d58343"} Jul 01 16:10:21.636536 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:21.636515 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sjstk" Jul 01 16:10:21.676607 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:21.676581 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sxwx" event={"ID":"e086c724-48fe-493d-b5db-98c9cf270913","Type":"ContainerStarted","Data":"4eb61160c114f12d111fc65c95947b527caaa84e55d280f6c2ccc2134277c617"} Jul 01 16:10:21.702392 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:21.702350 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4sxwx" podStartSLOduration=33.537960398 podStartE2EDuration="40.702334796s" totalImagesPullingTime="7.164374398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:21.701933468 +0000 UTC m=+111.901435146" watchObservedRunningTime="2026-07-01 16:10:21.702334796 +0000 UTC m=+111.901836476" Jul 01 16:10:23.041381 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.041348 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk"] Jul 01 16:10:23.044593 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.044575 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.048279 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.048253 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p4x8b\"" Jul 01 16:10:23.048495 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.048465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 16:10:23.049018 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.048985 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:10:23.049303 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.049286 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:10:23.053916 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.053883 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.054006 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.053937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04502e7b-fc30-4895-b086-2b9cb813cd35-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.054006 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.053977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.054006 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.054002 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrhnl\" (UniqueName: \"kubernetes.io/projected/04502e7b-fc30-4895-b086-2b9cb813cd35-kube-api-access-zrhnl\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.056872 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.056827 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk"] Jul 01 16:10:23.064107 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.064085 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-psdf9"] Jul 01 16:10:23.067176 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.067149 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.068631 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.068606 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9fj7"] Jul 01 16:10:23.069978 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.069960 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 16:10:23.070114 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.070095 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xpss8\"" Jul 01 16:10:23.070224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.070131 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:10:23.070224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.070177 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 16:10:23.071600 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.071581 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.074008 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.073989 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:10:23.075108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.075093 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lgms9\"" Jul 01 16:10:23.075316 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.075303 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:10:23.075831 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.075815 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:10:23.090083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.090065 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-psdf9"] Jul 01 16:10:23.154770 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154747 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-metrics-client-ca\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.154889 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.154889 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.154889 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154854 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrhnl\" (UniqueName: \"kubernetes.io/projected/04502e7b-fc30-4895-b086-2b9cb813cd35-kube-api-access-zrhnl\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.155049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-metrics-client-ca\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.155049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.154987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-wtmp\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155289 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.155289 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-textfile\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155289 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlq84\" (UniqueName: \"kubernetes.io/projected/a7b54be9-6ffd-4755-a40e-e955f6815836-kube-api-access-dlq84\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155289 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155189 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f36c7a13-cf76-4380-a5c9-73f66033c0d9-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.155289 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc99n\" (UniqueName: \"kubernetes.io/projected/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-api-access-qc99n\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.155469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155283 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.155469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155332 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-sys\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.155469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-root\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.155469 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04502e7b-fc30-4895-b086-2b9cb813cd35-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.156011 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.155991 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04502e7b-fc30-4895-b086-2b9cb813cd35-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.157294 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.157260 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.157598 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.157579 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/04502e7b-fc30-4895-b086-2b9cb813cd35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.164740 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.164716 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrhnl\" (UniqueName: \"kubernetes.io/projected/04502e7b-fc30-4895-b086-2b9cb813cd35-kube-api-access-zrhnl\") pod \"openshift-state-metrics-57f99c8b49-kbxdk\" (UID: \"04502e7b-fc30-4895-b086-2b9cb813cd35\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.255941 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.255918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-metrics-client-ca\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256043 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256086 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-metrics-client-ca\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256210 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256210 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-wtmp\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256210 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:23.256194 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:10:23.256362 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256362 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:10:23.256256 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls podName:a7b54be9-6ffd-4755-a40e-e955f6815836 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:23.756239609 +0000 UTC m=+113.955741279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls") pod "node-exporter-k9fj7" (UID: "a7b54be9-6ffd-4755-a40e-e955f6815836") : secret "node-exporter-tls" not found Jul 01 16:10:23.256362 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-textfile\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256362 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256301 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlq84\" (UniqueName: \"kubernetes.io/projected/a7b54be9-6ffd-4755-a40e-e955f6815836-kube-api-access-dlq84\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256362 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256340 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f36c7a13-cf76-4380-a5c9-73f66033c0d9-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc99n\" (UniqueName: \"kubernetes.io/projected/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-api-access-qc99n\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.256608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-sys\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256505 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-root\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256578 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-root\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256700 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256744 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b54be9-6ffd-4755-a40e-e955f6815836-metrics-client-ca\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.256887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256861 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-wtmp\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.257095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.256904 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-metrics-client-ca\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.257095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.257039 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7b54be9-6ffd-4755-a40e-e955f6815836-sys\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.257095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.257051 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-textfile\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.257245 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.257197 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f36c7a13-cf76-4380-a5c9-73f66033c0d9-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.257507 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.257482 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.258412 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.258385 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.258574 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.258558 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.258651 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.258636 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.270274 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.270254 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlq84\" (UniqueName: \"kubernetes.io/projected/a7b54be9-6ffd-4755-a40e-e955f6815836-kube-api-access-dlq84\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.270661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.270640 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc99n\" (UniqueName: \"kubernetes.io/projected/f36c7a13-cf76-4380-a5c9-73f66033c0d9-kube-api-access-qc99n\") pod \"kube-state-metrics-845b954455-psdf9\" (UID: \"f36c7a13-cf76-4380-a5c9-73f66033c0d9\") " pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.358779 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.358721 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" Jul 01 16:10:23.376652 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.376632 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" Jul 01 16:10:23.497506 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.497484 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk"] Jul 01 16:10:23.499740 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:23.499715 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04502e7b_fc30_4895_b086_2b9cb813cd35.slice/crio-3f6558713d188acc042d46b342c3197c121626417652f4f1b4aac7b5ef46b2a6 WatchSource:0}: Error finding container 3f6558713d188acc042d46b342c3197c121626417652f4f1b4aac7b5ef46b2a6: Status 404 returned error can't find the container with id 3f6558713d188acc042d46b342c3197c121626417652f4f1b4aac7b5ef46b2a6 Jul 01 16:10:23.517207 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.517113 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-psdf9"] Jul 01 16:10:23.519161 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:23.519138 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36c7a13_cf76_4380_a5c9_73f66033c0d9.slice/crio-ebd9a596d403fee5e845ea9313b44a0110136f1962e8f239eb0eb033151e80cf WatchSource:0}: Error finding container ebd9a596d403fee5e845ea9313b44a0110136f1962e8f239eb0eb033151e80cf: Status 404 returned error can't find the container with id ebd9a596d403fee5e845ea9313b44a0110136f1962e8f239eb0eb033151e80cf Jul 01 16:10:23.685151 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.685118 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" event={"ID":"f36c7a13-cf76-4380-a5c9-73f66033c0d9","Type":"ContainerStarted","Data":"ebd9a596d403fee5e845ea9313b44a0110136f1962e8f239eb0eb033151e80cf"} Jul 01 16:10:23.686931 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.686910 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" event={"ID":"04502e7b-fc30-4895-b086-2b9cb813cd35","Type":"ContainerStarted","Data":"1f41c519238ae4561dfdfa211f923878989cccd4cf54e2c4ba63215a4832d231"} Jul 01 16:10:23.687007 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.686957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" event={"ID":"04502e7b-fc30-4895-b086-2b9cb813cd35","Type":"ContainerStarted","Data":"c0ea5dc32d430e55b065ee351e18f715f6f91c0787a550d248f07e263f997877"} Jul 01 16:10:23.687007 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.686979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" event={"ID":"04502e7b-fc30-4895-b086-2b9cb813cd35","Type":"ContainerStarted","Data":"3f6558713d188acc042d46b342c3197c121626417652f4f1b4aac7b5ef46b2a6"} Jul 01 16:10:23.762318 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.762290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.764480 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.764454 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7b54be9-6ffd-4755-a40e-e955f6815836-node-exporter-tls\") pod \"node-exporter-k9fj7\" (UID: \"a7b54be9-6ffd-4755-a40e-e955f6815836\") " pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.981338 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:23.981314 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9fj7" Jul 01 16:10:23.991055 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:23.991031 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b54be9_6ffd_4755_a40e_e955f6815836.slice/crio-1dd32973e46d59166d29b0b9bc89808f378eb11cb7b1a1cd06033fc6c361257f WatchSource:0}: Error finding container 1dd32973e46d59166d29b0b9bc89808f378eb11cb7b1a1cd06033fc6c361257f: Status 404 returned error can't find the container with id 1dd32973e46d59166d29b0b9bc89808f378eb11cb7b1a1cd06033fc6c361257f Jul 01 16:10:24.692478 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:24.692445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fj7" event={"ID":"a7b54be9-6ffd-4755-a40e-e955f6815836","Type":"ContainerStarted","Data":"1dd32973e46d59166d29b0b9bc89808f378eb11cb7b1a1cd06033fc6c361257f"} Jul 01 16:10:24.866517 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:24.866481 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:10:24.871176 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:24.871154 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:25.040612 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.040583 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58bb4967f8-fxx7z"] Jul 01 16:10:25.044031 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.044010 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.046826 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.046804 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-45ip3tg9lhund\"" Jul 01 16:10:25.047090 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.047073 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 16:10:25.047159 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.047143 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k5snq\"" Jul 01 16:10:25.048132 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.048110 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 16:10:25.048132 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.048124 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 16:10:25.048271 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.048119 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 16:10:25.048271 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.048163 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 16:10:25.061210 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.060914 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bb4967f8-fxx7z"] Jul 01 16:10:25.070183 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070273 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtgmw\" (UniqueName: \"kubernetes.io/projected/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-kube-api-access-xtgmw\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070273 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070223 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-grpc-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070322 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.070356 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.070352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-metrics-client-ca\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171220 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171220 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171136 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-grpc-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171220 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171170 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171536 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171195 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171536 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-metrics-client-ca\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.171700 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.172407 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.171953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgmw\" (UniqueName: \"kubernetes.io/projected/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-kube-api-access-xtgmw\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.172407 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.172000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.173249 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.172900 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-metrics-client-ca\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.175105 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.175058 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.177996 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.177953 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.179441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.178181 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.179441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.178564 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.179441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.178919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.179441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.179393 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-secret-grpc-tls\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.182186 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.182161 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtgmw\" (UniqueName: \"kubernetes.io/projected/00a4135b-07f7-4ccd-815e-b7b3df0d7c26-kube-api-access-xtgmw\") pod \"thanos-querier-58bb4967f8-fxx7z\" (UID: \"00a4135b-07f7-4ccd-815e-b7b3df0d7c26\") " pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.354447 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.354402 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:25.517656 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.517622 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bb4967f8-fxx7z"] Jul 01 16:10:25.659093 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:25.659016 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a4135b_07f7_4ccd_815e_b7b3df0d7c26.slice/crio-dd097daf45f4a503247acdeb948a0eeabea5344f2c996467097e314c90cbe57e WatchSource:0}: Error finding container dd097daf45f4a503247acdeb948a0eeabea5344f2c996467097e314c90cbe57e: Status 404 returned error can't find the container with id dd097daf45f4a503247acdeb948a0eeabea5344f2c996467097e314c90cbe57e Jul 01 16:10:25.700461 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.700428 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"dd097daf45f4a503247acdeb948a0eeabea5344f2c996467097e314c90cbe57e"} Jul 01 16:10:25.702577 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.702545 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" event={"ID":"f36c7a13-cf76-4380-a5c9-73f66033c0d9","Type":"ContainerStarted","Data":"fe7706e4876483fc1748fa11ba562364198289354bdb2ca14b8123e8a2873ed8"} Jul 01 16:10:25.702685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.702606 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" event={"ID":"f36c7a13-cf76-4380-a5c9-73f66033c0d9","Type":"ContainerStarted","Data":"3bf287f1bca991a06b4a935ddf93323cf02828d31d79f221f37bd4c4914fe68a"} Jul 01 16:10:25.702685 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.702637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" event={"ID":"f36c7a13-cf76-4380-a5c9-73f66033c0d9","Type":"ContainerStarted","Data":"e6dd21992eadf81eb02115456950843bc744fb7a31a573942836ba1a914416e2"} Jul 01 16:10:25.704702 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.704681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" event={"ID":"04502e7b-fc30-4895-b086-2b9cb813cd35","Type":"ContainerStarted","Data":"fc1a4a67f4bef757f5fd10ee8f8ec5a7d3f6e4c7c6281b44d3e8f197a3446059"} Jul 01 16:10:25.723242 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.723121 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-psdf9" podStartSLOduration=1.151092774 podStartE2EDuration="2.72310768s" totalImagesPullingTime="1.572014906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:25.722119644 +0000 UTC m=+115.921621326" watchObservedRunningTime="2026-07-01 16:10:25.72310768 +0000 UTC m=+115.922609361" Jul 01 16:10:25.741745 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:25.741701 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kbxdk" podStartSLOduration=1.2590817890000001 podStartE2EDuration="2.741655928s" totalImagesPullingTime="1.482574139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:25.740438963 +0000 UTC m=+115.939940675" watchObservedRunningTime="2026-07-01 16:10:25.741655928 +0000 UTC m=+115.941157608" Jul 01 16:10:26.709737 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:26.709702 2583 generic.go:356] "Generic (PLEG): container finished" podID="a7b54be9-6ffd-4755-a40e-e955f6815836" containerID="19f14f402b891ec39f26e937b275e74cc8a9319439aa7ba15fafa3ecdaf5906c" exitCode=0 Jul 01 16:10:26.710125 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:26.709795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fj7" event={"ID":"a7b54be9-6ffd-4755-a40e-e955f6815836","Type":"ContainerDied","Data":"19f14f402b891ec39f26e937b275e74cc8a9319439aa7ba15fafa3ecdaf5906c"} Jul 01 16:10:27.716995 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.716956 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fj7" event={"ID":"a7b54be9-6ffd-4755-a40e-e955f6815836","Type":"ContainerStarted","Data":"4fe9b54b112af0378b1595aaf01e6d76237186d371a293f236d2402945263ada"} Jul 01 16:10:27.717370 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.717016 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fj7" event={"ID":"a7b54be9-6ffd-4755-a40e-e955f6815836","Type":"ContainerStarted","Data":"462cb6124969849089707e40e17683a9cbfc1b277358ac712b09b313a42121ae"} Jul 01 16:10:27.743650 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.743600 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9fj7" podStartSLOduration=2.9654671280000002 podStartE2EDuration="4.743582453s" totalImagesPullingTime="1.715677413s" totalInitContainerRuntime="62.437912ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:27.742660971 +0000 UTC m=+117.942162653" watchObservedRunningTime="2026-07-01 16:10:27.743582453 +0000 UTC m=+117.943084133" Jul 01 16:10:27.801217 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.801189 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-794x5"] Jul 01 16:10:27.806364 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.806339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:27.809076 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.809048 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 16:10:27.809194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.809112 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-57pc9\"" Jul 01 16:10:27.816270 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.816245 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-794x5"] Jul 01 16:10:27.892512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.892482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dp9t\" (UniqueName: \"kubernetes.io/projected/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-kube-api-access-9dp9t\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:27.892644 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.892559 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:27.993420 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.993392 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:27.993591 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.993492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dp9t\" (UniqueName: \"kubernetes.io/projected/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-kube-api-access-9dp9t\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:27.996131 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:27.996102 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:28.003080 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.003060 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dp9t\" (UniqueName: \"kubernetes.io/projected/3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2-kube-api-access-9dp9t\") pod \"monitoring-plugin-cd8656b8-794x5\" (UID: \"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:28.117642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.117611 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:28.308304 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.308243 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-794x5"] Jul 01 16:10:28.311993 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:28.311967 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b62b9bf_9a10_46f3_98b3_6cf7e659d3a2.slice/crio-18fb6465b19f6fd6e3a2d1e6eab1adf18f8c6891e0c9f683537ada88285a36b8 WatchSource:0}: Error finding container 18fb6465b19f6fd6e3a2d1e6eab1adf18f8c6891e0c9f683537ada88285a36b8: Status 404 returned error can't find the container with id 18fb6465b19f6fd6e3a2d1e6eab1adf18f8c6891e0c9f683537ada88285a36b8 Jul 01 16:10:28.723105 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.723075 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"c9339fccff798f1d283c2fab58c9e9e11101bc243dde33258dfb5651babb8458"} Jul 01 16:10:28.723523 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.723157 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"a9b22d651fc61ed342f8a4b96c518d26a5aa3033bd9e8df79b9bca9e467de1a2"} Jul 01 16:10:28.723523 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.723205 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"e0d4c649b485ffb958be43789a66d3a1e4275172d6d73e8291cb0717fc5beebf"} Jul 01 16:10:28.724165 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:28.724134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" event={"ID":"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2","Type":"ContainerStarted","Data":"18fb6465b19f6fd6e3a2d1e6eab1adf18f8c6891e0c9f683537ada88285a36b8"} Jul 01 16:10:30.733018 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.732980 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" event={"ID":"3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2","Type":"ContainerStarted","Data":"8f7cf6cb5dda104687ec33cddc40fd745a25c67163d80fe065e40312d58352c1"} Jul 01 16:10:30.733470 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.733036 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:30.736344 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.736313 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"fddc515702d4e208242eee322fda623555031215005ca298c2fa3c5e90c9d556"} Jul 01 16:10:30.736461 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.736426 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"4c860a7252923d68085333a917edf4c9535bf7dd9da43a76ac3beede1936dda7"} Jul 01 16:10:30.736537 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.736520 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:30.736582 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.736560 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" event={"ID":"00a4135b-07f7-4ccd-815e-b7b3df0d7c26","Type":"ContainerStarted","Data":"85cd0f7996f2d56b91f85062928d4a50f47dc2143f2341295a22ad091d85308b"} Jul 01 16:10:30.738432 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.738412 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" Jul 01 16:10:30.752941 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.752878 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-794x5" podStartSLOduration=2.303391703 podStartE2EDuration="3.752865902s" totalImagesPullingTime="1.449474199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:30.751486284 +0000 UTC m=+120.950987978" watchObservedRunningTime="2026-07-01 16:10:30.752865902 +0000 UTC m=+120.952367580" Jul 01 16:10:30.779301 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:30.779263 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" podStartSLOduration=1.878505522 podStartE2EDuration="5.779250947s" totalImagesPullingTime="3.900745425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:30.776625607 +0000 UTC m=+120.976127289" watchObservedRunningTime="2026-07-01 16:10:30.779250947 +0000 UTC m=+120.978752627" Jul 01 16:10:31.161483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:31.161409 2583 scope.go:117] "RemoveContainer" containerID="2470f99da4c9729e1687a146db171e8f0094a518d9ac848e4db2b1ee3ff36758" Jul 01 16:10:31.741818 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:31.741794 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:10:31.742186 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:31.741860 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" event={"ID":"11353c03-1887-4f6d-b25e-a4d81008696b","Type":"ContainerStarted","Data":"a63ba543aab7933d74421ead1a3ccece9a69703b9322b159b714da8e56517bbf"} Jul 01 16:10:31.742580 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:31.742518 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:10:31.763189 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:31.763148 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" podStartSLOduration=50.06725514 podStartE2EDuration="55.763134289s" totalImagesPullingTime="5.695879149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:31.762243872 +0000 UTC m=+121.961745553" watchObservedRunningTime="2026-07-01 16:10:31.763134289 +0000 UTC m=+121.962635985" Jul 01 16:10:32.225646 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.225618 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-zc2vd" Jul 01 16:10:32.404361 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.404325 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-c5fch"] Jul 01 16:10:32.407596 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.407580 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:32.410368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.410345 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zk4bp\"" Jul 01 16:10:32.410490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.410347 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 16:10:32.410546 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.410504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 16:10:32.420229 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.420205 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-c5fch"] Jul 01 16:10:32.430758 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.430732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4vd\" (UniqueName: \"kubernetes.io/projected/22229dc1-cdac-4088-9de5-f2cc88efaea9-kube-api-access-kh4vd\") pod \"downloads-5499b6fb8f-c5fch\" (UID: \"22229dc1-cdac-4088-9de5-f2cc88efaea9\") " pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:32.531885 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.531818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4vd\" (UniqueName: \"kubernetes.io/projected/22229dc1-cdac-4088-9de5-f2cc88efaea9-kube-api-access-kh4vd\") pod \"downloads-5499b6fb8f-c5fch\" (UID: \"22229dc1-cdac-4088-9de5-f2cc88efaea9\") " pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:32.540962 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.540937 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4vd\" (UniqueName: \"kubernetes.io/projected/22229dc1-cdac-4088-9de5-f2cc88efaea9-kube-api-access-kh4vd\") pod \"downloads-5499b6fb8f-c5fch\" (UID: \"22229dc1-cdac-4088-9de5-f2cc88efaea9\") " pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:32.717463 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.717439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:32.844944 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:32.844923 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-c5fch"] Jul 01 16:10:32.847799 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:32.847772 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22229dc1_cdac_4088_9de5_f2cc88efaea9.slice/crio-ee54ae86e271ac19a5ba381f2064c89c6f83a69d65fcf2160c743644051f1f32 WatchSource:0}: Error finding container ee54ae86e271ac19a5ba381f2064c89c6f83a69d65fcf2160c743644051f1f32: Status 404 returned error can't find the container with id ee54ae86e271ac19a5ba381f2064c89c6f83a69d65fcf2160c743644051f1f32 Jul 01 16:10:33.752354 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:33.752316 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-c5fch" event={"ID":"22229dc1-cdac-4088-9de5-f2cc88efaea9","Type":"ContainerStarted","Data":"ee54ae86e271ac19a5ba381f2064c89c6f83a69d65fcf2160c743644051f1f32"} Jul 01 16:10:36.748606 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:36.748570 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58bb4967f8-fxx7z" Jul 01 16:10:40.092991 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.092957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:10:40.095190 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.095167 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f343be-0b67-44db-85a8-ab535755108c-metrics-certs\") pod \"network-metrics-daemon-96fqf\" (UID: \"18f343be-0b67-44db-85a8-ab535755108c\") " pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:10:40.378427 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.378360 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:10:40.386015 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.385989 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96fqf" Jul 01 16:10:40.528796 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.528771 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-96fqf"] Jul 01 16:10:40.531337 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:40.531306 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f343be_0b67_44db_85a8_ab535755108c.slice/crio-b8d33fc00a9ec89a4f409f2d46d56ab689f8caee651dd1192f74606bded8508c WatchSource:0}: Error finding container b8d33fc00a9ec89a4f409f2d46d56ab689f8caee651dd1192f74606bded8508c: Status 404 returned error can't find the container with id b8d33fc00a9ec89a4f409f2d46d56ab689f8caee651dd1192f74606bded8508c Jul 01 16:10:40.785292 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:40.785259 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96fqf" event={"ID":"18f343be-0b67-44db-85a8-ab535755108c","Type":"ContainerStarted","Data":"b8d33fc00a9ec89a4f409f2d46d56ab689f8caee651dd1192f74606bded8508c"} Jul 01 16:10:41.792191 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:41.792118 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96fqf" event={"ID":"18f343be-0b67-44db-85a8-ab535755108c","Type":"ContainerStarted","Data":"80fd236723c20c153b7c037c6d239dc20a3947f8691891a56518398ad20c3309"} Jul 01 16:10:41.792605 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:41.792213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96fqf" event={"ID":"18f343be-0b67-44db-85a8-ab535755108c","Type":"ContainerStarted","Data":"538719cdb91bf391008577cff0e186d2b69af1a10827e74054c3f1341867e601"} Jul 01 16:10:41.812051 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:41.811995 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-96fqf" podStartSLOduration=130.846654846 podStartE2EDuration="2m11.811977608s" totalImagesPullingTime="965.322762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:41.811484658 +0000 UTC m=+132.010986342" watchObservedRunningTime="2026-07-01 16:10:41.811977608 +0000 UTC m=+132.011479291" Jul 01 16:10:42.938253 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.938222 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:10:42.941560 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.941542 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:42.944654 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.944626 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 16:10:42.946011 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.945981 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 16:10:42.946137 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.946051 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 16:10:42.946486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.946469 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 16:10:42.946566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.946487 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 16:10:42.946671 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.946654 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sjbpc\"" Jul 01 16:10:42.958528 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:42.958506 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:10:43.016711 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016684 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4vwf\" (UniqueName: \"kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.016820 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016729 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.016820 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016747 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.016820 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016807 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.017004 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016827 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.017004 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.016853 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118212 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118212 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4vwf\" (UniqueName: \"kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118212 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118212 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118407 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.118888 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.118865 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.119030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.119006 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.119030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.119023 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.120595 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.120574 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.120662 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.120595 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.127617 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.127593 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4vwf\" (UniqueName: \"kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf\") pod \"console-56f988f78f-45lxd\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.251442 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.251414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:43.383426 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.383398 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:10:43.386704 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:43.386679 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6c1e34_896b_4eeb_a1fd_e6106851fb67.slice/crio-33003cbb3804b01d98e1e10d5e8c41b7a2334e5b9f342d3c90dee5653d0fe8ec WatchSource:0}: Error finding container 33003cbb3804b01d98e1e10d5e8c41b7a2334e5b9f342d3c90dee5653d0fe8ec: Status 404 returned error can't find the container with id 33003cbb3804b01d98e1e10d5e8c41b7a2334e5b9f342d3c90dee5653d0fe8ec Jul 01 16:10:43.802727 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:43.802689 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f988f78f-45lxd" event={"ID":"8c6c1e34-896b-4eeb-a1fd-e6106851fb67","Type":"ContainerStarted","Data":"33003cbb3804b01d98e1e10d5e8c41b7a2334e5b9f342d3c90dee5653d0fe8ec"} Jul 01 16:10:49.200992 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:49.200961 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-tsm5p_f39d12dc-383b-4510-b00a-96b81ad13b9d/cluster-monitoring-operator/0.log" Jul 01 16:10:49.399982 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:49.399955 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-state-metrics/0.log" Jul 01 16:10:49.598892 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:49.598858 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-rbac-proxy-main/0.log" Jul 01 16:10:49.799035 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:49.798986 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-rbac-proxy-self/0.log" Jul 01 16:10:49.889042 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:49.888966 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" podUID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" containerName="registry" containerID="cri-o://2dbb5b51ef3d4511c1405b7377a686467cbc471c24cb4f0dc4a382eef1a94b4a" gracePeriod=30 Jul 01 16:10:50.199257 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:50.199178 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-794x5_3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2/monitoring-plugin/0.log" Jul 01 16:10:50.998288 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:50.998263 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/init-textfile/0.log" Jul 01 16:10:51.199555 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:51.199524 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/node-exporter/0.log" Jul 01 16:10:51.398900 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:51.398813 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/kube-rbac-proxy/0.log" Jul 01 16:10:51.841192 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:51.841160 2583 generic.go:356] "Generic (PLEG): container finished" podID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" containerID="2dbb5b51ef3d4511c1405b7377a686467cbc471c24cb4f0dc4a382eef1a94b4a" exitCode=0 Jul 01 16:10:51.841351 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:51.841240 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" event={"ID":"fe2162a5-f94b-4d70-ae1e-ae3e755df7de","Type":"ContainerDied","Data":"2dbb5b51ef3d4511c1405b7377a686467cbc471c24cb4f0dc4a382eef1a94b4a"} Jul 01 16:10:52.199360 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.199249 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/kube-rbac-proxy-main/0.log" Jul 01 16:10:52.398283 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.398245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/kube-rbac-proxy-self/0.log" Jul 01 16:10:52.598344 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.598316 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/openshift-state-metrics/0.log" Jul 01 16:10:52.846734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.846700 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" event={"ID":"fe2162a5-f94b-4d70-ae1e-ae3e755df7de","Type":"ContainerDied","Data":"a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1"} Jul 01 16:10:52.846896 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.846758 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a528d9545e43bdcb7060de64f7485f36e718915eaeb4fd416b16df9329a6fea1" Jul 01 16:10:52.848261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.848232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f988f78f-45lxd" event={"ID":"8c6c1e34-896b-4eeb-a1fd-e6106851fb67","Type":"ContainerStarted","Data":"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834"} Jul 01 16:10:52.868500 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.868424 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f988f78f-45lxd" podStartSLOduration=1.527718438 podStartE2EDuration="10.868410504s" totalImagesPullingTime="9.340692066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:52.867247672 +0000 UTC m=+143.066749353" watchObservedRunningTime="2026-07-01 16:10:52.868410504 +0000 UTC m=+143.067912184" Jul 01 16:10:52.887983 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:52.887961 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:53.007130 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007102 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007293 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007170 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007293 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007269 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007305 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007361 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007388 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007415 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbgmm\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007626 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007442 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") pod \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\" (UID: \"fe2162a5-f94b-4d70-ae1e-ae3e755df7de\") " Jul 01 16:10:53.007729 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007697 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:10:53.007857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.007817 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-trusted-ca\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.008681 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.008244 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:10:53.010348 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.010246 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:10:53.011391 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.011351 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:53.011635 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.011488 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm" (OuterVolumeSpecName: "kube-api-access-jbgmm") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "kube-api-access-jbgmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:53.011635 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.011618 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:10:53.011781 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.011759 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:53.018220 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.018193 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fe2162a5-f94b-4d70-ae1e-ae3e755df7de" (UID: "fe2162a5-f94b-4d70-ae1e-ae3e755df7de"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:10:53.108657 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108629 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-tls\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108657 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108656 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-installation-pull-secrets\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108667 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-image-registry-private-configuration\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108678 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-registry-certificates\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108686 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-ca-trust-extracted\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108694 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-bound-sa-token\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.108824 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.108702 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbgmm\" (UniqueName: \"kubernetes.io/projected/fe2162a5-f94b-4d70-ae1e-ae3e755df7de-kube-api-access-jbgmm\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:10:53.116240 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.116209 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:10:53.116678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.116646 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" containerName="registry" Jul 01 16:10:53.116678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.116668 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" containerName="registry" Jul 01 16:10:53.116821 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.116758 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" containerName="registry" Jul 01 16:10:53.121828 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.121770 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.132251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.132227 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:10:53.133272 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.133252 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 16:10:53.209096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209245 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209323 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209379 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.209524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.209441 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6px2\" (UniqueName: \"kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.252504 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.252477 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:53.252644 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.252534 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:53.258205 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.258185 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:53.310855 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.310812 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6px2\" (UniqueName: \"kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.310996 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.310899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.310996 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.310925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.310996 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.310963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.311152 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.310995 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.311152 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.311052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.311152 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.311107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.312315 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.311802 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.312315 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.312056 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.312315 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.312276 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.312527 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.312447 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.313917 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.313896 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.314016 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.313976 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.320979 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.320956 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6px2\" (UniqueName: \"kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2\") pod \"console-7dc5b4cd78-mm42p\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.436051 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.435973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:10:53.590315 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.590284 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:10:53.593083 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:10:53.593044 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b44b9c8_ffdc_4c0e_8554_62584d2d6e34.slice/crio-b892b1d18e58eb516a4fff8ae8cf5256ce94d37ce019633f6e152d2ce043f47d WatchSource:0}: Error finding container b892b1d18e58eb516a4fff8ae8cf5256ce94d37ce019633f6e152d2ce043f47d: Status 404 returned error can't find the container with id b892b1d18e58eb516a4fff8ae8cf5256ce94d37ce019633f6e152d2ce043f47d Jul 01 16:10:53.855549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.855512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5b4cd78-mm42p" event={"ID":"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34","Type":"ContainerStarted","Data":"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e"} Jul 01 16:10:53.855735 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.855574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5b4cd78-mm42p" event={"ID":"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34","Type":"ContainerStarted","Data":"b892b1d18e58eb516a4fff8ae8cf5256ce94d37ce019633f6e152d2ce043f47d"} Jul 01 16:10:53.857507 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.857476 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b454f7ddc-tmbm5" Jul 01 16:10:53.857507 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.857473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-c5fch" event={"ID":"22229dc1-cdac-4088-9de5-f2cc88efaea9","Type":"ContainerStarted","Data":"f366628bf44f2898f2cc50b0bdf8eeecfd6871598bf5b30c1f679c636fcb9aef"} Jul 01 16:10:53.858019 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.857996 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:53.862139 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.862117 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:10:53.870796 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.870777 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-c5fch" Jul 01 16:10:53.876252 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.876204 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc5b4cd78-mm42p" podStartSLOduration=0.876185946 podStartE2EDuration="876.185946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:53.875547364 +0000 UTC m=+144.075049050" watchObservedRunningTime="2026-07-01 16:10:53.876185946 +0000 UTC m=+144.075687630" Jul 01 16:10:53.919538 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.919480 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-c5fch" podStartSLOduration=2.006841504 podStartE2EDuration="21.919462218s" totalImagesPullingTime="19.912620714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:53.917471696 +0000 UTC m=+144.116973397" watchObservedRunningTime="2026-07-01 16:10:53.919462218 +0000 UTC m=+144.118963900" Jul 01 16:10:53.936634 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.936585 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:10:53.942597 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:53.942494 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b454f7ddc-tmbm5"] Jul 01 16:10:54.167586 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:54.167501 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2162a5-f94b-4d70-ae1e-ae3e755df7de" path="/var/lib/kubelet/pods/fe2162a5-f94b-4d70-ae1e-ae3e755df7de/volumes" Jul 01 16:10:54.600406 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:54.600368 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-klzfc_c77f816a-5ecb-46a5-81ed-837b67d7dbf3/prometheus-operator-admission-webhook/0.log" Jul 01 16:10:54.799647 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:54.799613 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/thanos-query/0.log" Jul 01 16:10:54.998958 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:54.998926 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-web/0.log" Jul 01 16:10:55.199254 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:55.199227 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy/0.log" Jul 01 16:10:55.398591 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:55.398520 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/prom-label-proxy/0.log" Jul 01 16:10:55.598914 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:55.598881 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-rules/0.log" Jul 01 16:10:55.798761 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:55.798734 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-metrics/0.log" Jul 01 16:10:56.207757 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:56.207678 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:10:56.400481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:56.400452 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/3.log" Jul 01 16:10:56.599162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:56.599140 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56f988f78f-45lxd_8c6c1e34-896b-4eeb-a1fd-e6106851fb67/console/0.log" Jul 01 16:10:56.800792 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:10:56.800760 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-c5fch_22229dc1-cdac-4088-9de5-f2cc88efaea9/download-server/0.log" Jul 01 16:11:03.436946 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:03.436909 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:11:03.437407 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:03.436964 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:11:03.441277 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:03.441250 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:11:03.906117 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:03.906092 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:11:03.955734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:03.955707 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:11:13.945100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:13.945069 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e5f02da-b908-477b-90fd-6c5d6b16452d" containerID="2f5b6d104261abcd2d9f7e054874706e69abb96c885f4d88eb97d9d82d106307" exitCode=0 Jul 01 16:11:13.945571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:13.945149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" event={"ID":"6e5f02da-b908-477b-90fd-6c5d6b16452d","Type":"ContainerDied","Data":"2f5b6d104261abcd2d9f7e054874706e69abb96c885f4d88eb97d9d82d106307"} Jul 01 16:11:13.945571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:13.945524 2583 scope.go:117] "RemoveContainer" containerID="2f5b6d104261abcd2d9f7e054874706e69abb96c885f4d88eb97d9d82d106307" Jul 01 16:11:14.950468 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:14.950432 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2hqh2" event={"ID":"6e5f02da-b908-477b-90fd-6c5d6b16452d","Type":"ContainerStarted","Data":"a980752a11bb029e141b4c69b22f8447e2ff099d74530bd1c7e7924288671ac9"} Jul 01 16:11:28.977442 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:28.977345 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56f988f78f-45lxd" podUID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" containerName="console" containerID="cri-o://aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834" gracePeriod=15 Jul 01 16:11:29.249259 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.249210 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:11:29.286526 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286497 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.286636 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286563 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.286636 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286592 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.286636 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286618 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.286791 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286681 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.286791 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286724 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4vwf\" (UniqueName: \"kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf\") pod \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\" (UID: \"8c6c1e34-896b-4eeb-a1fd-e6106851fb67\") " Jul 01 16:11:29.287043 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.286908 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:29.287153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.287095 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:29.287153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.287105 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config" (OuterVolumeSpecName: "console-config") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:29.288857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.288782 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:29.288857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.288803 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:29.289015 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.288915 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf" (OuterVolumeSpecName: "kube-api-access-w4vwf") pod "8c6c1e34-896b-4eeb-a1fd-e6106851fb67" (UID: "8c6c1e34-896b-4eeb-a1fd-e6106851fb67"). InnerVolumeSpecName "kube-api-access-w4vwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:11:29.388057 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388032 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:29.388057 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388054 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4vwf\" (UniqueName: \"kubernetes.io/projected/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-kube-api-access-w4vwf\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:29.388177 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388065 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-oauth-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:29.388177 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388074 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-oauth-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:29.388177 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388083 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-console-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:29.388177 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:29.388092 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c6c1e34-896b-4eeb-a1fd-e6106851fb67-service-ca\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:11:30.016459 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.016427 2583 generic.go:356] "Generic (PLEG): container finished" podID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" containerID="aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834" exitCode=0 Jul 01 16:11:30.016867 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.016467 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f988f78f-45lxd" event={"ID":"8c6c1e34-896b-4eeb-a1fd-e6106851fb67","Type":"ContainerDied","Data":"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834"} Jul 01 16:11:30.016867 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.016498 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f988f78f-45lxd" Jul 01 16:11:30.016867 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.016536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f988f78f-45lxd" event={"ID":"8c6c1e34-896b-4eeb-a1fd-e6106851fb67","Type":"ContainerDied","Data":"33003cbb3804b01d98e1e10d5e8c41b7a2334e5b9f342d3c90dee5653d0fe8ec"} Jul 01 16:11:30.016867 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.016560 2583 scope.go:117] "RemoveContainer" containerID="aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834" Jul 01 16:11:30.026039 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.026016 2583 scope.go:117] "RemoveContainer" containerID="aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834" Jul 01 16:11:30.026395 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:11:30.026367 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834\": container with ID starting with aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834 not found: ID does not exist" containerID="aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834" Jul 01 16:11:30.026499 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.026401 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834"} err="failed to get container status \"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834\": rpc error: code = NotFound desc = could not find container \"aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834\": container with ID starting with aea0f99d4a2c4c5150d70f53004900b376d5af6e6ce70b4bfad18c6ab8d00834 not found: ID does not exist" Jul 01 16:11:30.040541 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.040518 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:11:30.044649 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.044627 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f988f78f-45lxd"] Jul 01 16:11:30.165750 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:30.165727 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" path="/var/lib/kubelet/pods/8c6c1e34-896b-4eeb-a1fd-e6106851fb67/volumes" Jul 01 16:11:47.427454 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.427413 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4"] Jul 01 16:11:47.428486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.428458 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" containerName="console" Jul 01 16:11:47.428486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.428487 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" containerName="console" Jul 01 16:11:47.428642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.428566 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c6c1e34-896b-4eeb-a1fd-e6106851fb67" containerName="console" Jul 01 16:11:47.432218 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.432201 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.435512 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.435491 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cq2dq\"" Jul 01 16:11:47.435617 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.435530 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 16:11:47.435786 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.435764 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 16:11:47.435914 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.435796 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 16:11:47.435914 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.435821 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 16:11:47.437070 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.437052 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 16:11:47.441975 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.441956 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 16:11:47.461325 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.461297 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4"] Jul 01 16:11:47.517575 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517675 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-metrics-client-ca\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517675 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-serving-certs-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517675 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517650 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd2kh\" (UniqueName: \"kubernetes.io/projected/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-kube-api-access-jd2kh\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-federate-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.517806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.517799 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618078 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618049 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-metrics-client-ca\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618178 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-serving-certs-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618178 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd2kh\" (UniqueName: \"kubernetes.io/projected/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-kube-api-access-jd2kh\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-federate-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618341 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618460 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618460 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.618925 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618901 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-metrics-client-ca\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.619090 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.618924 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-serving-certs-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.619227 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.619209 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.620893 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.620870 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.620893 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.620879 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-telemeter-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.621067 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.621051 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-federate-client-tls\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.621151 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.621128 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.626767 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.626745 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd2kh\" (UniqueName: \"kubernetes.io/projected/4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8-kube-api-access-jd2kh\") pod \"telemeter-client-79d64b6cdb-kl2m4\" (UID: \"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8\") " pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.742280 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.742260 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" Jul 01 16:11:47.876063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:47.876038 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4"] Jul 01 16:11:47.877586 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:11:47.877562 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4dd30a_bc8c_4296_aeb8_b37d1a52cba8.slice/crio-fa3e96cbe45bda59720e330290d736f67b63fd734550f463d45d1815bf7ef966 WatchSource:0}: Error finding container fa3e96cbe45bda59720e330290d736f67b63fd734550f463d45d1815bf7ef966: Status 404 returned error can't find the container with id fa3e96cbe45bda59720e330290d736f67b63fd734550f463d45d1815bf7ef966 Jul 01 16:11:48.091094 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:48.091035 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" event={"ID":"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8","Type":"ContainerStarted","Data":"fa3e96cbe45bda59720e330290d736f67b63fd734550f463d45d1815bf7ef966"} Jul 01 16:11:50.101776 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:50.101746 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" event={"ID":"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8","Type":"ContainerStarted","Data":"c452624d53427981c177e64b3b976ec253adad401bfafb431649a8293b9a357b"} Jul 01 16:11:51.106907 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.106875 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" event={"ID":"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8","Type":"ContainerStarted","Data":"1a996c9fafd2035e626a6f219786d79aadbb50aa547137a8eff2e51b44be041c"} Jul 01 16:11:51.107186 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.106933 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" event={"ID":"4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8","Type":"ContainerStarted","Data":"f6c4a4bfc125bd518a9cebb094ce40194356ab427105fce2b165609e80dbb80c"} Jul 01 16:11:51.133798 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.133709 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79d64b6cdb-kl2m4" podStartSLOduration=1.087694776 podStartE2EDuration="4.133673257s" totalImagesPullingTime="3.045978481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:11:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:11:51.132089795 +0000 UTC m=+201.331591487" watchObservedRunningTime="2026-07-01 16:11:51.133673257 +0000 UTC m=+201.333174940" Jul 01 16:11:51.906020 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.905983 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:11:51.909516 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.909494 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.922119 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.922096 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:11:51.954509 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954625 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954625 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954536 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954720 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954720 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954656 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954720 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954676 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6dc\" (UniqueName: \"kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:51.954720 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:51.954696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055438 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055533 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055444 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055533 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6dc\" (UniqueName: \"kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055533 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055676 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055676 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.055676 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.055574 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.056364 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.056340 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.056462 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.056426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.056526 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.056458 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.056590 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.056568 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.057988 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.057960 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.058083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.058037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.064826 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.064808 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6dc\" (UniqueName: \"kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc\") pod \"console-749b898ff4-5n5sj\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.219682 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.219654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:11:52.352623 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:52.352594 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:11:52.356115 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:11:52.356077 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12846266_e449_456b_b366_1e422d4d2c50.slice/crio-deb842911210ed0c56daf2d6af4f9b01774278aac4166059f8b6730d1aa34b1e WatchSource:0}: Error finding container deb842911210ed0c56daf2d6af4f9b01774278aac4166059f8b6730d1aa34b1e: Status 404 returned error can't find the container with id deb842911210ed0c56daf2d6af4f9b01774278aac4166059f8b6730d1aa34b1e Jul 01 16:11:53.117358 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:53.117316 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b898ff4-5n5sj" event={"ID":"12846266-e449-456b-b366-1e422d4d2c50","Type":"ContainerStarted","Data":"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb"} Jul 01 16:11:53.117603 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:53.117381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b898ff4-5n5sj" event={"ID":"12846266-e449-456b-b366-1e422d4d2c50","Type":"ContainerStarted","Data":"deb842911210ed0c56daf2d6af4f9b01774278aac4166059f8b6730d1aa34b1e"} Jul 01 16:11:53.143375 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:11:53.143319 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-749b898ff4-5n5sj" podStartSLOduration=2.143301501 podStartE2EDuration="2.143301501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:11:53.141002147 +0000 UTC m=+203.340503849" watchObservedRunningTime="2026-07-01 16:11:53.143301501 +0000 UTC m=+203.342803179" Jul 01 16:12:02.220414 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:02.220371 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:12:02.220909 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:02.220433 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:12:02.225052 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:02.225027 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:12:03.171354 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:03.171327 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:12:03.221119 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:03.221091 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:12:28.242456 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.242406 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dc5b4cd78-mm42p" podUID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" containerName="console" containerID="cri-o://569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e" gracePeriod=15 Jul 01 16:12:28.493932 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.493881 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:12:28.614591 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614566 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.614714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614596 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.614714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614613 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.614714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614647 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.614714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614682 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.614714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614697 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6px2\" (UniqueName: \"kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.615000 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.614741 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle\") pod \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\" (UID: \"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34\") " Jul 01 16:12:28.615117 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.615079 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:12:28.615196 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.615165 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config" (OuterVolumeSpecName: "console-config") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:12:28.615249 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.615207 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:12:28.615249 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.615216 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:12:28.616723 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.616692 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:12:28.616812 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.616731 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:12:28.616812 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.616744 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2" (OuterVolumeSpecName: "kube-api-access-v6px2") pod "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" (UID: "3b44b9c8-ffdc-4c0e-8554-62584d2d6e34"). InnerVolumeSpecName "kube-api-access-v6px2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:12:28.715814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715791 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-oauth-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715811 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-oauth-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715950 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715821 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715950 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715829 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-console-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715950 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715865 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-service-ca\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715950 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715878 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6px2\" (UniqueName: \"kubernetes.io/projected/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-kube-api-access-v6px2\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:28.715950 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:28.715891 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34-trusted-ca-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:12:29.280763 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.280733 2583 generic.go:356] "Generic (PLEG): container finished" podID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" containerID="569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e" exitCode=0 Jul 01 16:12:29.281162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.280778 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5b4cd78-mm42p" Jul 01 16:12:29.281162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.280817 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5b4cd78-mm42p" event={"ID":"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34","Type":"ContainerDied","Data":"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e"} Jul 01 16:12:29.281162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.280888 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5b4cd78-mm42p" event={"ID":"3b44b9c8-ffdc-4c0e-8554-62584d2d6e34","Type":"ContainerDied","Data":"b892b1d18e58eb516a4fff8ae8cf5256ce94d37ce019633f6e152d2ce043f47d"} Jul 01 16:12:29.281162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.280911 2583 scope.go:117] "RemoveContainer" containerID="569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e" Jul 01 16:12:29.289770 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.289752 2583 scope.go:117] "RemoveContainer" containerID="569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e" Jul 01 16:12:29.290114 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:12:29.290092 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e\": container with ID starting with 569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e not found: ID does not exist" containerID="569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e" Jul 01 16:12:29.290195 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.290124 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e"} err="failed to get container status \"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e\": rpc error: code = NotFound desc = could not find container \"569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e\": container with ID starting with 569826a355b3c499ea36d601aa6b3b6f958b42c9b288eb26fbb458279389789e not found: ID does not exist" Jul 01 16:12:29.305148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.305127 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:12:29.310200 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:29.310180 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc5b4cd78-mm42p"] Jul 01 16:12:30.165282 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:30.165258 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" path="/var/lib/kubelet/pods/3b44b9c8-ffdc-4c0e-8554-62584d2d6e34/volumes" Jul 01 16:12:58.437251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.437154 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:12:58.437764 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.437573 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" containerName="console" Jul 01 16:12:58.437764 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.437594 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" containerName="console" Jul 01 16:12:58.437764 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.437696 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b44b9c8-ffdc-4c0e-8554-62584d2d6e34" containerName="console" Jul 01 16:12:58.440886 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.440859 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.457702 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.457672 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:12:58.527755 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.527981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.527981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.527981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527908 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fs5d\" (UniqueName: \"kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.527981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.527981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.527968 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.528168 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.528000 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.628821 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628783 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.628821 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fs5d\" (UniqueName: \"kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628914 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628943 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.628998 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629753 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.629725 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.629727 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.629887 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.629730 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.630144 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.630120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.631492 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.631473 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.631583 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.631508 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.637823 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.637788 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fs5d\" (UniqueName: \"kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d\") pod \"console-67b78ffc7f-bl56h\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.750489 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.750453 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:12:58.885939 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:58.885914 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:12:58.887778 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:12:58.887751 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6d00f5_c5d3_4c59_a828_8c7cbc0a9822.slice/crio-a887b31a93f102d4268c50425c223250addee32c403136f47983d1be93298fe1 WatchSource:0}: Error finding container a887b31a93f102d4268c50425c223250addee32c403136f47983d1be93298fe1: Status 404 returned error can't find the container with id a887b31a93f102d4268c50425c223250addee32c403136f47983d1be93298fe1 Jul 01 16:12:59.406116 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:59.406078 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b78ffc7f-bl56h" event={"ID":"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822","Type":"ContainerStarted","Data":"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa"} Jul 01 16:12:59.406368 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:59.406126 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b78ffc7f-bl56h" event={"ID":"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822","Type":"ContainerStarted","Data":"a887b31a93f102d4268c50425c223250addee32c403136f47983d1be93298fe1"} Jul 01 16:12:59.427021 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:12:59.426967 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b78ffc7f-bl56h" podStartSLOduration=1.426950815 podStartE2EDuration="1.426950815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:12:59.426227478 +0000 UTC m=+269.625729161" watchObservedRunningTime="2026-07-01 16:12:59.426950815 +0000 UTC m=+269.626452567" Jul 01 16:13:08.751290 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:08.751241 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:13:08.751713 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:08.751313 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:13:08.756250 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:08.756219 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:13:09.454762 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:09.454729 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:13:09.529733 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:09.529700 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:13:30.108282 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:30.108252 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:13:30.111754 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:30.111725 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:13:30.112211 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:30.112177 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:13:30.115933 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:30.115911 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:13:30.120031 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:30.120011 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:13:34.550940 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.550878 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-749b898ff4-5n5sj" podUID="12846266-e449-456b-b366-1e422d4d2c50" containerName="console" containerID="cri-o://ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb" gracePeriod=15 Jul 01 16:13:34.794652 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.794627 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:13:34.916180 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916101 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916180 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916160 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl6dc\" (UniqueName: \"kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916394 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916190 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916394 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916205 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916394 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916228 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916394 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916253 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916394 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916287 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert\") pod \"12846266-e449-456b-b366-1e422d4d2c50\" (UID: \"12846266-e449-456b-b366-1e422d4d2c50\") " Jul 01 16:13:34.916638 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916499 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:13:34.916804 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916751 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca" (OuterVolumeSpecName: "service-ca") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:13:34.916804 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916794 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:13:34.917028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.916762 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config" (OuterVolumeSpecName: "console-config") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:13:34.918582 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.918557 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:13:34.918690 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.918615 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:13:34.918752 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:34.918704 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc" (OuterVolumeSpecName: "kube-api-access-cl6dc") pod "12846266-e449-456b-b366-1e422d4d2c50" (UID: "12846266-e449-456b-b366-1e422d4d2c50"). InnerVolumeSpecName "kube-api-access-cl6dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:13:35.017086 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017049 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-trusted-ca-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017086 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017078 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl6dc\" (UniqueName: \"kubernetes.io/projected/12846266-e449-456b-b366-1e422d4d2c50-kube-api-access-cl6dc\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017086 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017088 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-service-ca\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017086 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017099 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-console-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017346 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017108 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017346 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017117 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12846266-e449-456b-b366-1e422d4d2c50-console-oauth-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.017346 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.017125 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12846266-e449-456b-b366-1e422d4d2c50-oauth-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:13:35.553091 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.553049 2583 generic.go:356] "Generic (PLEG): container finished" podID="12846266-e449-456b-b366-1e422d4d2c50" containerID="ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb" exitCode=0 Jul 01 16:13:35.553571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.553097 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b898ff4-5n5sj" Jul 01 16:13:35.553571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.553117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b898ff4-5n5sj" event={"ID":"12846266-e449-456b-b366-1e422d4d2c50","Type":"ContainerDied","Data":"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb"} Jul 01 16:13:35.553571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.553162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b898ff4-5n5sj" event={"ID":"12846266-e449-456b-b366-1e422d4d2c50","Type":"ContainerDied","Data":"deb842911210ed0c56daf2d6af4f9b01774278aac4166059f8b6730d1aa34b1e"} Jul 01 16:13:35.553571 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.553185 2583 scope.go:117] "RemoveContainer" containerID="ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb" Jul 01 16:13:35.562100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.562084 2583 scope.go:117] "RemoveContainer" containerID="ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb" Jul 01 16:13:35.562346 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:13:35.562326 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb\": container with ID starting with ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb not found: ID does not exist" containerID="ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb" Jul 01 16:13:35.562388 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.562354 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb"} err="failed to get container status \"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb\": rpc error: code = NotFound desc = could not find container \"ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb\": container with ID starting with ab20f226fd1d712b00ff8062f08cb8123d43f5224321b94920405d6a96fdeacb not found: ID does not exist" Jul 01 16:13:35.576753 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.576728 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:13:35.583747 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:35.583727 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-749b898ff4-5n5sj"] Jul 01 16:13:36.165448 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:36.165411 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12846266-e449-456b-b366-1e422d4d2c50" path="/var/lib/kubelet/pods/12846266-e449-456b-b366-1e422d4d2c50/volumes" Jul 01 16:13:50.749134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.749100 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq"] Jul 01 16:13:50.749915 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.749884 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12846266-e449-456b-b366-1e422d4d2c50" containerName="console" Jul 01 16:13:50.749915 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.749909 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="12846266-e449-456b-b366-1e422d4d2c50" containerName="console" Jul 01 16:13:50.750129 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.750112 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="12846266-e449-456b-b366-1e422d4d2c50" containerName="console" Jul 01 16:13:50.755194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.755169 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.765334 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.765316 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:13:50.766692 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.766677 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:13:50.766743 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.766681 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2hzll\"" Jul 01 16:13:50.776214 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.776186 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq"] Jul 01 16:13:50.853485 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.853444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.853700 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.853546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdvt6\" (UniqueName: \"kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.853700 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.853592 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.954113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.954077 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.954250 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.954151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.954250 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.954192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdvt6\" (UniqueName: \"kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.954482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.954461 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.954524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.954486 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:50.964810 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:50.964782 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdvt6\" (UniqueName: \"kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:51.063396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:51.063334 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:13:51.202372 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:51.202350 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq"] Jul 01 16:13:51.204030 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:13:51.204004 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7756457_a83c_4132_be93_41c6765df4ea.slice/crio-841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d WatchSource:0}: Error finding container 841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d: Status 404 returned error can't find the container with id 841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d Jul 01 16:13:51.205937 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:51.205920 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:13:51.622032 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:51.621992 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" event={"ID":"e7756457-a83c-4132-be93-41c6765df4ea","Type":"ContainerStarted","Data":"841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d"} Jul 01 16:13:59.659390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:59.659355 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7756457-a83c-4132-be93-41c6765df4ea" containerID="c5c7c4ae1a4941c68a10e44e45c13f3e6e3cdbdc6a26f32289f3e370fe7b0bdc" exitCode=0 Jul 01 16:13:59.659863 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:13:59.659434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" event={"ID":"e7756457-a83c-4132-be93-41c6765df4ea","Type":"ContainerDied","Data":"c5c7c4ae1a4941c68a10e44e45c13f3e6e3cdbdc6a26f32289f3e370fe7b0bdc"} Jul 01 16:14:02.674410 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:02.674368 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7756457-a83c-4132-be93-41c6765df4ea" containerID="6606fc6b0bbb3ae195ac13e428c1df166d95e487fa663d56b5a1845d58a484e8" exitCode=0 Jul 01 16:14:02.674809 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:02.674454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" event={"ID":"e7756457-a83c-4132-be93-41c6765df4ea","Type":"ContainerDied","Data":"6606fc6b0bbb3ae195ac13e428c1df166d95e487fa663d56b5a1845d58a484e8"} Jul 01 16:14:13.729613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:13.729563 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7756457-a83c-4132-be93-41c6765df4ea" containerID="dfef189a77dbe531698185c5d1b192aecb06a199760e5d87054674a4f2af01a7" exitCode=0 Jul 01 16:14:13.730023 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:13.729660 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" event={"ID":"e7756457-a83c-4132-be93-41c6765df4ea","Type":"ContainerDied","Data":"dfef189a77dbe531698185c5d1b192aecb06a199760e5d87054674a4f2af01a7"} Jul 01 16:14:14.885642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.885604 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:14:14.956200 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.956170 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle\") pod \"e7756457-a83c-4132-be93-41c6765df4ea\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " Jul 01 16:14:14.956336 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.956209 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdvt6\" (UniqueName: \"kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6\") pod \"e7756457-a83c-4132-be93-41c6765df4ea\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " Jul 01 16:14:14.956336 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.956240 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util\") pod \"e7756457-a83c-4132-be93-41c6765df4ea\" (UID: \"e7756457-a83c-4132-be93-41c6765df4ea\") " Jul 01 16:14:14.956799 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.956776 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle" (OuterVolumeSpecName: "bundle") pod "e7756457-a83c-4132-be93-41c6765df4ea" (UID: "e7756457-a83c-4132-be93-41c6765df4ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:14.958505 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.958476 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6" (OuterVolumeSpecName: "kube-api-access-cdvt6") pod "e7756457-a83c-4132-be93-41c6765df4ea" (UID: "e7756457-a83c-4132-be93-41c6765df4ea"). InnerVolumeSpecName "kube-api-access-cdvt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:14:14.961367 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:14.961342 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util" (OuterVolumeSpecName: "util") pod "e7756457-a83c-4132-be93-41c6765df4ea" (UID: "e7756457-a83c-4132-be93-41c6765df4ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:15.057236 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.057185 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:15.057236 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.057205 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdvt6\" (UniqueName: \"kubernetes.io/projected/e7756457-a83c-4132-be93-41c6765df4ea-kube-api-access-cdvt6\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:15.057236 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.057216 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7756457-a83c-4132-be93-41c6765df4ea-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:15.740161 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.740131 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" event={"ID":"e7756457-a83c-4132-be93-41c6765df4ea","Type":"ContainerDied","Data":"841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d"} Jul 01 16:14:15.740319 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.740176 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="841b02fb8b7466e9e68c5e67f911290240ca94340d834295df7a61fa189b891d" Jul 01 16:14:15.740319 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:15.740141 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddp6tq" Jul 01 16:14:24.009147 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009055 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4"] Jul 01 16:14:24.009823 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009787 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="pull" Jul 01 16:14:24.009823 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009825 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="pull" Jul 01 16:14:24.010083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009854 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="extract" Jul 01 16:14:24.010083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009864 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="extract" Jul 01 16:14:24.010083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009894 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="util" Jul 01 16:14:24.010083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.009904 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="util" Jul 01 16:14:24.010083 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.010057 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7756457-a83c-4132-be93-41c6765df4ea" containerName="extract" Jul 01 16:14:24.013886 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.013864 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.019873 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.019827 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fjrtc\"" Jul 01 16:14:24.020011 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.019908 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 16:14:24.020364 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.020237 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:14:24.051597 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.051570 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4"] Jul 01 16:14:24.128798 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.128771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lnf\" (UniqueName: \"kubernetes.io/projected/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-kube-api-access-69lnf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.128958 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.128805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.229521 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.229484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69lnf\" (UniqueName: \"kubernetes.io/projected/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-kube-api-access-69lnf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.229521 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.229527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.229928 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.229909 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.242065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.242037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lnf\" (UniqueName: \"kubernetes.io/projected/bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052-kube-api-access-69lnf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-c4zc4\" (UID: \"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.322904 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.322800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" Jul 01 16:14:24.502251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.502226 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4"] Jul 01 16:14:24.504324 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:14:24.504293 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf61c9f9_f9b2_4f0e_9c34_f03ce0eae052.slice/crio-e601edfe9ee7031ba3bb3e78be6aee5cb77115b91ae28b75dee0c44a55a32de2 WatchSource:0}: Error finding container e601edfe9ee7031ba3bb3e78be6aee5cb77115b91ae28b75dee0c44a55a32de2: Status 404 returned error can't find the container with id e601edfe9ee7031ba3bb3e78be6aee5cb77115b91ae28b75dee0c44a55a32de2 Jul 01 16:14:24.777721 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:24.777689 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" event={"ID":"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052","Type":"ContainerStarted","Data":"e601edfe9ee7031ba3bb3e78be6aee5cb77115b91ae28b75dee0c44a55a32de2"} Jul 01 16:14:26.790916 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:26.790880 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" event={"ID":"bf61c9f9-f9b2-4f0e-9c34-f03ce0eae052","Type":"ContainerStarted","Data":"30e8f2a62f9aefbc4caf0547d4a5a459dc97c0777e179e8c602e9b3a580d537b"} Jul 01 16:14:26.831853 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:26.831794 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-c4zc4" podStartSLOduration=2.121881804 podStartE2EDuration="3.831776509s" totalImagesPullingTime="1.709894705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:14:26.831434154 +0000 UTC m=+357.030935836" watchObservedRunningTime="2026-07-01 16:14:26.831776509 +0000 UTC m=+357.031278190" Jul 01 16:14:27.879701 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.879670 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p"] Jul 01 16:14:27.883243 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.883220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:27.887364 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.886964 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2hzll\"" Jul 01 16:14:27.887364 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.887219 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:14:27.888486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.888318 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:14:27.907441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.907415 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p"] Jul 01 16:14:27.958182 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.958154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:27.958301 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.958191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:27.958342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:27.958300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvc4\" (UniqueName: \"kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.058711 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.058661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvc4\" (UniqueName: \"kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.058917 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.058730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.058917 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.058756 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.059111 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.059094 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.059183 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.059163 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.083073 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.083041 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvc4\" (UniqueName: \"kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.195430 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.195353 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:28.347736 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.347673 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p"] Jul 01 16:14:28.349941 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:14:28.349910 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39818788_eff6_4d02_bc1b_901f5b41328a.slice/crio-3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea WatchSource:0}: Error finding container 3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea: Status 404 returned error can't find the container with id 3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea Jul 01 16:14:28.796440 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.796406 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr"] Jul 01 16:14:28.799725 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.799698 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.800122 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.800093 2583 generic.go:356] "Generic (PLEG): container finished" podID="39818788-eff6-4d02-bc1b-901f5b41328a" containerID="84e428fcf373bbf64f6001277cb44680cc55b7eb61a45ac4230da07997be95c1" exitCode=0 Jul 01 16:14:28.800261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.800168 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" event={"ID":"39818788-eff6-4d02-bc1b-901f5b41328a","Type":"ContainerDied","Data":"84e428fcf373bbf64f6001277cb44680cc55b7eb61a45ac4230da07997be95c1"} Jul 01 16:14:28.800261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.800218 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" event={"ID":"39818788-eff6-4d02-bc1b-901f5b41328a","Type":"ContainerStarted","Data":"3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea"} Jul 01 16:14:28.803690 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.803665 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-84m4g\"" Jul 01 16:14:28.804785 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.804761 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 16:14:28.804897 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.804849 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 16:14:28.816488 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.816464 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr"] Jul 01 16:14:28.865482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.865457 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.865568 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.865528 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j587v\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-kube-api-access-j587v\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.966284 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.966264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j587v\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-kube-api-access-j587v\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.966564 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.966311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.983089 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.983062 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j587v\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-kube-api-access-j587v\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:28.983170 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:28.983116 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cba42a36-1d9d-47a6-994b-7a4ad116fe4c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4mkwr\" (UID: \"cba42a36-1d9d-47a6-994b-7a4ad116fe4c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:29.109267 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:29.109243 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:29.242680 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:29.242654 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr"] Jul 01 16:14:29.244501 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:14:29.244471 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcba42a36_1d9d_47a6_994b_7a4ad116fe4c.slice/crio-56d9c5c1e49a4ba006f196f6bc27bed3a0af6bd5cd1358af6e9ebf89a4c0b40d WatchSource:0}: Error finding container 56d9c5c1e49a4ba006f196f6bc27bed3a0af6bd5cd1358af6e9ebf89a4c0b40d: Status 404 returned error can't find the container with id 56d9c5c1e49a4ba006f196f6bc27bed3a0af6bd5cd1358af6e9ebf89a4c0b40d Jul 01 16:14:29.808053 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:29.808013 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" event={"ID":"cba42a36-1d9d-47a6-994b-7a4ad116fe4c","Type":"ContainerStarted","Data":"56d9c5c1e49a4ba006f196f6bc27bed3a0af6bd5cd1358af6e9ebf89a4c0b40d"} Jul 01 16:14:31.100405 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.100373 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2"] Jul 01 16:14:31.103727 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.103701 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.107535 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.107507 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2k5qh\"" Jul 01 16:14:31.120208 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.120184 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2"] Jul 01 16:14:31.185629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.185608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.185749 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.185651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pbj5\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-kube-api-access-7pbj5\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.286253 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.286223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.286909 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.286879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pbj5\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-kube-api-access-7pbj5\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.298854 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.298816 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.301253 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.301228 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pbj5\" (UniqueName: \"kubernetes.io/projected/75371f57-8aea-4e81-997c-7163398999e8-kube-api-access-7pbj5\") pod \"cert-manager-cainjector-5d99449ffd-5c5t2\" (UID: \"75371f57-8aea-4e81-997c-7163398999e8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.412696 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.412609 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" Jul 01 16:14:31.570795 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:31.570763 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2"] Jul 01 16:14:32.219918 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:14:32.219881 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75371f57_8aea_4e81_997c_7163398999e8.slice/crio-0f6876f44d25ce280c433135846792555fd9473af05cd698eeaf15ee26945410 WatchSource:0}: Error finding container 0f6876f44d25ce280c433135846792555fd9473af05cd698eeaf15ee26945410: Status 404 returned error can't find the container with id 0f6876f44d25ce280c433135846792555fd9473af05cd698eeaf15ee26945410 Jul 01 16:14:32.833955 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:32.833914 2583 generic.go:356] "Generic (PLEG): container finished" podID="39818788-eff6-4d02-bc1b-901f5b41328a" containerID="b8177e15e723d3f6be86995c219b22288fe53f2cc2bb7acdcf6f7ce935a71cb3" exitCode=0 Jul 01 16:14:32.834259 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:32.833971 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" event={"ID":"39818788-eff6-4d02-bc1b-901f5b41328a","Type":"ContainerDied","Data":"b8177e15e723d3f6be86995c219b22288fe53f2cc2bb7acdcf6f7ce935a71cb3"} Jul 01 16:14:32.835819 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:32.835799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" event={"ID":"75371f57-8aea-4e81-997c-7163398999e8","Type":"ContainerStarted","Data":"0f6876f44d25ce280c433135846792555fd9473af05cd698eeaf15ee26945410"} Jul 01 16:14:33.844401 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:33.844366 2583 generic.go:356] "Generic (PLEG): container finished" podID="39818788-eff6-4d02-bc1b-901f5b41328a" containerID="168c1c9a584b115c25101355f9423e9d336441212f1bc91dd5a6c72e4abec832" exitCode=0 Jul 01 16:14:33.844921 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:33.844459 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" event={"ID":"39818788-eff6-4d02-bc1b-901f5b41328a","Type":"ContainerDied","Data":"168c1c9a584b115c25101355f9423e9d336441212f1bc91dd5a6c72e4abec832"} Jul 01 16:14:34.850002 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:34.849966 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" event={"ID":"75371f57-8aea-4e81-997c-7163398999e8","Type":"ContainerStarted","Data":"9dd80b60541524d9edb35d9b21168299acdbe8691fd99e1245dfaab27e9ede62"} Jul 01 16:14:34.851439 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:34.851414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" event={"ID":"cba42a36-1d9d-47a6-994b-7a4ad116fe4c","Type":"ContainerStarted","Data":"21dc0c7dc7a2b657d88717346109dbc68537c7ad2a0a70d54845b416eba532e6"} Jul 01 16:14:34.869095 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:34.869051 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5c5t2" podStartSLOduration=1.968458938 podStartE2EDuration="3.869036483s" totalImagesPullingTime="1.900577545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:14:34.868034293 +0000 UTC m=+365.067535975" watchObservedRunningTime="2026-07-01 16:14:34.869036483 +0000 UTC m=+365.068538162" Jul 01 16:14:34.892439 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:34.892392 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" podStartSLOduration=2.017239157 podStartE2EDuration="6.892376826s" totalImagesPullingTime="4.875137669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:14:34.891043239 +0000 UTC m=+365.090544925" watchObservedRunningTime="2026-07-01 16:14:34.892376826 +0000 UTC m=+365.091878507" Jul 01 16:14:34.981529 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:34.981503 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:35.120389 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.120298 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle\") pod \"39818788-eff6-4d02-bc1b-901f5b41328a\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " Jul 01 16:14:35.120544 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.120400 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util\") pod \"39818788-eff6-4d02-bc1b-901f5b41328a\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " Jul 01 16:14:35.120544 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.120423 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljvc4\" (UniqueName: \"kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4\") pod \"39818788-eff6-4d02-bc1b-901f5b41328a\" (UID: \"39818788-eff6-4d02-bc1b-901f5b41328a\") " Jul 01 16:14:35.120753 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.120729 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle" (OuterVolumeSpecName: "bundle") pod "39818788-eff6-4d02-bc1b-901f5b41328a" (UID: "39818788-eff6-4d02-bc1b-901f5b41328a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:35.122565 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.122536 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4" (OuterVolumeSpecName: "kube-api-access-ljvc4") pod "39818788-eff6-4d02-bc1b-901f5b41328a" (UID: "39818788-eff6-4d02-bc1b-901f5b41328a"). InnerVolumeSpecName "kube-api-access-ljvc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:14:35.124331 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.124309 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util" (OuterVolumeSpecName: "util") pod "39818788-eff6-4d02-bc1b-901f5b41328a" (UID: "39818788-eff6-4d02-bc1b-901f5b41328a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:35.227097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.222318 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:35.227097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.222368 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljvc4\" (UniqueName: \"kubernetes.io/projected/39818788-eff6-4d02-bc1b-901f5b41328a-kube-api-access-ljvc4\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:35.227097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.222385 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39818788-eff6-4d02-bc1b-901f5b41328a-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:35.858448 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.858412 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" Jul 01 16:14:35.858448 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.858435 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4w29p" event={"ID":"39818788-eff6-4d02-bc1b-901f5b41328a","Type":"ContainerDied","Data":"3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea"} Jul 01 16:14:35.858925 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.858509 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b2402d4c67b7166850fe8ee549613e240055377221db2114fa34607b3a085ea" Jul 01 16:14:35.858925 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:35.858782 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:41.865130 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:41.865097 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4mkwr" Jul 01 16:14:51.414032 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.413997 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699"] Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414285 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="util" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414295 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="util" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414315 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="extract" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414320 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="extract" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414333 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="pull" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414341 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="pull" Jul 01 16:14:51.414433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.414397 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="39818788-eff6-4d02-bc1b-901f5b41328a" containerName="extract" Jul 01 16:14:51.418027 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.418010 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.423318 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.423297 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:14:51.423592 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.423570 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:14:51.424829 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.424810 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2hzll\"" Jul 01 16:14:51.429794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.429773 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699"] Jul 01 16:14:51.542467 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.542443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.542584 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.542474 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4qvn\" (UniqueName: \"kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.542584 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.542515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.643153 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.643126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.643261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.643157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4qvn\" (UniqueName: \"kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.643261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.643187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.643566 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.643551 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.643608 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.643590 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.653262 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.653237 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4qvn\" (UniqueName: \"kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.726935 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.726916 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:51.864012 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.863981 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699"] Jul 01 16:14:51.866434 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:14:51.866407 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27904808_22cc_4575_ab3f_26b40b3d383e.slice/crio-e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48 WatchSource:0}: Error finding container e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48: Status 404 returned error can't find the container with id e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48 Jul 01 16:14:51.932030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.932007 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerStarted","Data":"1035aeda3ac19eaa8d92405ccc4dd58f184cf33ba1513c3c56e683021fe6e50c"} Jul 01 16:14:51.932123 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:51.932057 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerStarted","Data":"e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48"} Jul 01 16:14:52.938228 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:52.938150 2583 generic.go:356] "Generic (PLEG): container finished" podID="27904808-22cc-4575-ab3f-26b40b3d383e" containerID="1035aeda3ac19eaa8d92405ccc4dd58f184cf33ba1513c3c56e683021fe6e50c" exitCode=0 Jul 01 16:14:52.938228 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:52.938215 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerDied","Data":"1035aeda3ac19eaa8d92405ccc4dd58f184cf33ba1513c3c56e683021fe6e50c"} Jul 01 16:14:53.944517 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:53.944448 2583 generic.go:356] "Generic (PLEG): container finished" podID="27904808-22cc-4575-ab3f-26b40b3d383e" containerID="125c24791d81c6582d52191734a01a59aab45bf231d332bbeaab777b3c8b84b4" exitCode=0 Jul 01 16:14:53.944517 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:53.944512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerDied","Data":"125c24791d81c6582d52191734a01a59aab45bf231d332bbeaab777b3c8b84b4"} Jul 01 16:14:54.950659 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:54.950623 2583 generic.go:356] "Generic (PLEG): container finished" podID="27904808-22cc-4575-ab3f-26b40b3d383e" containerID="28d40dc0436963bfe970fdcd257b87fc2c8b898bd9aacf6559b3a4d509cfed59" exitCode=0 Jul 01 16:14:54.951044 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:54.950708 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerDied","Data":"28d40dc0436963bfe970fdcd257b87fc2c8b898bd9aacf6559b3a4d509cfed59"} Jul 01 16:14:56.075881 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.075859 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:56.077943 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.077923 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4qvn\" (UniqueName: \"kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn\") pod \"27904808-22cc-4575-ab3f-26b40b3d383e\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " Jul 01 16:14:56.078053 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.077970 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util\") pod \"27904808-22cc-4575-ab3f-26b40b3d383e\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " Jul 01 16:14:56.078053 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.078002 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle\") pod \"27904808-22cc-4575-ab3f-26b40b3d383e\" (UID: \"27904808-22cc-4575-ab3f-26b40b3d383e\") " Jul 01 16:14:56.078701 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.078675 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle" (OuterVolumeSpecName: "bundle") pod "27904808-22cc-4575-ab3f-26b40b3d383e" (UID: "27904808-22cc-4575-ab3f-26b40b3d383e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:56.079880 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.079854 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn" (OuterVolumeSpecName: "kube-api-access-n4qvn") pod "27904808-22cc-4575-ab3f-26b40b3d383e" (UID: "27904808-22cc-4575-ab3f-26b40b3d383e"). InnerVolumeSpecName "kube-api-access-n4qvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:14:56.084065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.084039 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util" (OuterVolumeSpecName: "util") pod "27904808-22cc-4575-ab3f-26b40b3d383e" (UID: "27904808-22cc-4575-ab3f-26b40b3d383e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:14:56.178984 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.178952 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4qvn\" (UniqueName: \"kubernetes.io/projected/27904808-22cc-4575-ab3f-26b40b3d383e-kube-api-access-n4qvn\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:56.178984 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.178984 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:56.178984 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.178993 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27904808-22cc-4575-ab3f-26b40b3d383e-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:14:56.961526 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.961496 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" Jul 01 16:14:56.961690 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.961495 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcd699" event={"ID":"27904808-22cc-4575-ab3f-26b40b3d383e","Type":"ContainerDied","Data":"e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48"} Jul 01 16:14:56.961690 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:14:56.961619 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9937114feedb13b1c1d4db2dad0bbfa58d9aaf9c42d3ca3f2269759451c5c48" Jul 01 16:15:05.422174 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422140 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9"] Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422449 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="pull" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422460 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="pull" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422472 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="util" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422477 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="util" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422482 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="extract" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422488 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="extract" Jul 01 16:15:05.422642 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.422549 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27904808-22cc-4575-ab3f-26b40b3d383e" containerName="extract" Jul 01 16:15:05.426240 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.426224 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.430180 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.430157 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:15:05.431231 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.431206 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:15:05.431300 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.431272 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:15:05.431300 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.431272 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:15:05.432826 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.432807 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vx4q\"" Jul 01 16:15:05.442958 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.442936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpvvf\" (UniqueName: \"kubernetes.io/projected/83c310cd-3a2d-404a-80e2-6a5470e61bc2-kube-api-access-gpvvf\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.443099 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.442972 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.443099 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.442991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.443099 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.443066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.443251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.443101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.450396 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.450375 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9"] Jul 01 16:15:05.543767 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.543737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.543903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.543774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.543903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.543819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvvf\" (UniqueName: \"kubernetes.io/projected/83c310cd-3a2d-404a-80e2-6a5470e61bc2-kube-api-access-gpvvf\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.543903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.543862 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.543903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.543879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.544241 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.544223 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.546196 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.546174 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83c310cd-3a2d-404a-80e2-6a5470e61bc2-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.546307 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.546251 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.546466 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.546446 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83c310cd-3a2d-404a-80e2-6a5470e61bc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.569865 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.566452 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvvf\" (UniqueName: \"kubernetes.io/projected/83c310cd-3a2d-404a-80e2-6a5470e61bc2-kube-api-access-gpvvf\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-26kz9\" (UID: \"83c310cd-3a2d-404a-80e2-6a5470e61bc2\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.737483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.737456 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:05.913774 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:05.913676 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9"] Jul 01 16:15:06.006629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.006563 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" event={"ID":"83c310cd-3a2d-404a-80e2-6a5470e61bc2","Type":"ContainerStarted","Data":"79bc1f3d62c2770c01d1123e6ef0cb1ce3c93b62c3857e1d5214814458496104"} Jul 01 16:15:06.033871 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.033825 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4"] Jul 01 16:15:06.038542 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.038522 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.045165 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 16:15:06.045165 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045128 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 16:15:06.045395 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045375 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hpkn9\"" Jul 01 16:15:06.045684 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045621 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 16:15:06.045754 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:15:06.045881 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.045862 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 16:15:06.048273 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.048254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-manager-config\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.048349 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.048294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9fl\" (UniqueName: \"kubernetes.io/projected/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-kube-api-access-zh9fl\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.048349 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.048318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.048423 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.048358 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.052826 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.052808 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4"] Jul 01 16:15:06.149462 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.149440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-manager-config\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.149574 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.149484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9fl\" (UniqueName: \"kubernetes.io/projected/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-kube-api-access-zh9fl\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.149574 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.149503 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.149574 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.149560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.150071 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.150052 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-manager-config\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.151986 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.151966 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.152059 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.152012 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.165387 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.165363 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9fl\" (UniqueName: \"kubernetes.io/projected/d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e-kube-api-access-zh9fl\") pod \"lws-controller-manager-69bb744ddb-dczq4\" (UID: \"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.348265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.348185 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:06.489870 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:06.489829 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4"] Jul 01 16:15:06.493966 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:15:06.493940 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6504a12_7b78_4e6d_93c1_e45b1b4c2c5e.slice/crio-2c404844d463d70e9f69e7b172dd447ceb20cc40040d31bcc90731f13e9321fc WatchSource:0}: Error finding container 2c404844d463d70e9f69e7b172dd447ceb20cc40040d31bcc90731f13e9321fc: Status 404 returned error can't find the container with id 2c404844d463d70e9f69e7b172dd447ceb20cc40040d31bcc90731f13e9321fc Jul 01 16:15:07.012207 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:07.012166 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" event={"ID":"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e","Type":"ContainerStarted","Data":"2c404844d463d70e9f69e7b172dd447ceb20cc40040d31bcc90731f13e9321fc"} Jul 01 16:15:11.035483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:11.035451 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" event={"ID":"d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e","Type":"ContainerStarted","Data":"f07e710f4899f5a9b35d6947dc3e5338411c08b90e2ff1ab547cdd547f7edfbb"} Jul 01 16:15:11.035903 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:11.035595 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:11.037033 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:11.037009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" event={"ID":"83c310cd-3a2d-404a-80e2-6a5470e61bc2","Type":"ContainerStarted","Data":"84e5ba56a71768bb85b8e5dece87e55371e44a87dad511150466675d5a919351"} Jul 01 16:15:11.082070 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:11.077348 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" podStartSLOduration=1.318767917 podStartE2EDuration="5.077329793s" totalImagesPullingTime="3.758561876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:11.076818168 +0000 UTC m=+401.276319850" watchObservedRunningTime="2026-07-01 16:15:11.077329793 +0000 UTC m=+401.276831476" Jul 01 16:15:12.044139 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:12.044106 2583 generic.go:356] "Generic (PLEG): container finished" podID="83c310cd-3a2d-404a-80e2-6a5470e61bc2" containerID="84e5ba56a71768bb85b8e5dece87e55371e44a87dad511150466675d5a919351" exitCode=0 Jul 01 16:15:12.044505 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:12.044198 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" event={"ID":"83c310cd-3a2d-404a-80e2-6a5470e61bc2","Type":"ContainerDied","Data":"84e5ba56a71768bb85b8e5dece87e55371e44a87dad511150466675d5a919351"} Jul 01 16:15:13.051683 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:13.051646 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" event={"ID":"83c310cd-3a2d-404a-80e2-6a5470e61bc2","Type":"ContainerStarted","Data":"f70717cac21a36e6288dae5cf7a5f087e7daef2af8814f1f2de0e59b2258682d"} Jul 01 16:15:13.052035 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:13.051759 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:13.248687 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:13.248638 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" podStartSLOduration=2.333354622 podStartE2EDuration="8.248621245s" totalImagesPullingTime="4.924981119s" totalInitContainerRuntime="990.285504ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:13.244119071 +0000 UTC m=+403.443620756" watchObservedRunningTime="2026-07-01 16:15:13.248621245 +0000 UTC m=+403.448122925" Jul 01 16:15:22.046825 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:22.046791 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-dczq4" Jul 01 16:15:24.060058 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:24.060019 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-26kz9" Jul 01 16:15:34.150328 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.150294 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-zxwhp"] Jul 01 16:15:34.155275 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.155251 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.158465 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.158441 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-j5czb\"" Jul 01 16:15:34.158559 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.158524 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 16:15:34.172709 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.168591 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-zxwhp"] Jul 01 16:15:34.259555 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.259521 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-redirect-config\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.259703 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.259568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k6tx\" (UniqueName: \"kubernetes.io/projected/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-kube-api-access-5k6tx\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.360518 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.360479 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-redirect-config\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.360669 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.360534 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k6tx\" (UniqueName: \"kubernetes.io/projected/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-kube-api-access-5k6tx\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.361261 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.361240 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-redirect-config\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.377417 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.377392 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k6tx\" (UniqueName: \"kubernetes.io/projected/fee31f6f-10c3-4772-bc3a-0a862fcf2e4d-kube-api-access-5k6tx\") pod \"dashboard-redirect-5968f65d96-zxwhp\" (UID: \"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d\") " pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.465878 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.465785 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" Jul 01 16:15:34.604800 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:34.604774 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-zxwhp"] Jul 01 16:15:35.162275 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:35.162222 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" event={"ID":"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d","Type":"ContainerStarted","Data":"f1a37f6539524457fce0d86dbdabcf08bc93c12ca19b74f3a984025084811668"} Jul 01 16:15:40.191151 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:40.191113 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" event={"ID":"fee31f6f-10c3-4772-bc3a-0a862fcf2e4d","Type":"ContainerStarted","Data":"d5613dac8578e4a53fc3e495b2e3c3d0f4d412c40d1a9e6783386292c34f3670"} Jul 01 16:15:40.283121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:40.283073 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5968f65d96-zxwhp" podStartSLOduration=1.4573930019999999 podStartE2EDuration="6.283059747s" totalImagesPullingTime="4.825666745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:40.280672504 +0000 UTC m=+430.480174185" watchObservedRunningTime="2026-07-01 16:15:40.283059747 +0000 UTC m=+430.482561813" Jul 01 16:15:42.049556 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.049516 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8"] Jul 01 16:15:42.053335 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.053316 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.057536 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.057510 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 16:15:42.057670 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.057510 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:15:42.057946 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.057927 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:15:42.058041 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.057970 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 16:15:42.058041 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.057980 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 16:15:42.058302 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.058285 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:15:42.058928 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.058913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z59jb\"" Jul 01 16:15:42.074711 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.074684 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8"] Jul 01 16:15:42.124088 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124067 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124186 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124100 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124246 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124296 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124245 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c3d217-1272-4679-a0eb-f734d660e6a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124296 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124270 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twp47\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-kube-api-access-twp47\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124397 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.124397 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.124390 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.224871 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.224829 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.224976 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.224879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.224976 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.224897 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.224976 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.224919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.225148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.224977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.225148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.225011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c3d217-1272-4679-a0eb-f734d660e6a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.225148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.225038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twp47\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-kube-api-access-twp47\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.225559 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.225530 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.227328 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.227300 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c3d217-1272-4679-a0eb-f734d660e6a3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.227427 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.227347 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.227734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.227711 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.227774 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.227720 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.240872 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.240832 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.241345 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.241324 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twp47\" (UniqueName: \"kubernetes.io/projected/90c3d217-1272-4679-a0eb-f734d660e6a3-kube-api-access-twp47\") pod \"istiod-openshift-gateway-94bb8fbfd-bbtq8\" (UID: \"90c3d217-1272-4679-a0eb-f734d660e6a3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.363673 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.363618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:42.552640 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:42.552611 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8"] Jul 01 16:15:42.553876 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:15:42.553833 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c3d217_1272_4679_a0eb_f734d660e6a3.slice/crio-03e3771064bbfd235edf3f67aa2121cf19dae067f5f9ad42cebee0d23798b737 WatchSource:0}: Error finding container 03e3771064bbfd235edf3f67aa2121cf19dae067f5f9ad42cebee0d23798b737: Status 404 returned error can't find the container with id 03e3771064bbfd235edf3f67aa2121cf19dae067f5f9ad42cebee0d23798b737 Jul 01 16:15:43.214339 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:43.214302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" event={"ID":"90c3d217-1272-4679-a0eb-f734d660e6a3","Type":"ContainerStarted","Data":"03e3771064bbfd235edf3f67aa2121cf19dae067f5f9ad42cebee0d23798b737"} Jul 01 16:15:45.112644 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:45.112603 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 16:15:45.112949 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:45.112676 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 01 16:15:45.226096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:45.226067 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" event={"ID":"90c3d217-1272-4679-a0eb-f734d660e6a3","Type":"ContainerStarted","Data":"8f40fba25e4e85a00be57274f75e6b7efe46cae50ae72af8d543e7815513617a"} Jul 01 16:15:45.226234 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:45.226175 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:15:45.297074 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:45.297017 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" podStartSLOduration=0.740938346 podStartE2EDuration="3.296998479s" totalImagesPullingTime="2.556060133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:45.295080455 +0000 UTC m=+435.494582138" watchObservedRunningTime="2026-07-01 16:15:45.296998479 +0000 UTC m=+435.496500161" Jul 01 16:15:46.232772 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:46.232740 2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bbtq8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 16:15:46.233157 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:46.232802 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" podUID="90c3d217-1272-4679-a0eb-f734d660e6a3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:15:49.232629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:15:49.232589 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bbtq8" Jul 01 16:16:30.143593 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:30.143562 2583 scope.go:117] "RemoveContainer" containerID="2dbb5b51ef3d4511c1405b7377a686467cbc471c24cb4f0dc4a382eef1a94b4a" Jul 01 16:16:53.342955 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.342919 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5875f67f46-ltzb2"] Jul 01 16:16:53.347764 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.347740 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.359453 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.359431 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5875f67f46-ltzb2"] Jul 01 16:16:53.469975 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.469949 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.469993 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.470047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-oauth-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.470076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-trusted-ca-bundle\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.470096 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-oauth-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.470154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-service-ca\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.470285 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.470199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jk4h\" (UniqueName: \"kubernetes.io/projected/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-kube-api-access-4jk4h\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.570960 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.570938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.570972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-oauth-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.570989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-trusted-ca-bundle\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-oauth-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-service-ca\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571065 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jk4h\" (UniqueName: \"kubernetes.io/projected/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-kube-api-access-4jk4h\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571308 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571075 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571790 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571766 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571930 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571909 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-service-ca\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.571977 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.571909 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-oauth-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.572072 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.572053 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-trusted-ca-bundle\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.573932 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.573911 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-serving-cert\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.573932 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.573915 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-console-oauth-config\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.580312 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.580288 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jk4h\" (UniqueName: \"kubernetes.io/projected/ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1-kube-api-access-4jk4h\") pod \"console-5875f67f46-ltzb2\" (UID: \"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1\") " pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.658130 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.658079 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:16:53.796562 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:53.796536 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5875f67f46-ltzb2"] Jul 01 16:16:53.798121 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:16:53.798089 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1abd5f_1a42_4d1d_b86d_8a4a0d5ed9a1.slice/crio-046d7173fd5103f40cea5856f6083381780b52e8d71d300e3ab6288fbdab8063 WatchSource:0}: Error finding container 046d7173fd5103f40cea5856f6083381780b52e8d71d300e3ab6288fbdab8063: Status 404 returned error can't find the container with id 046d7173fd5103f40cea5856f6083381780b52e8d71d300e3ab6288fbdab8063 Jul 01 16:16:54.567591 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:54.567553 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5875f67f46-ltzb2" event={"ID":"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1","Type":"ContainerStarted","Data":"7fd3b2e3af8fee649c224d387c1e2b60d9a8b3128984f7fc907042734e2b9d59"} Jul 01 16:16:54.567999 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:54.567603 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5875f67f46-ltzb2" event={"ID":"ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1","Type":"ContainerStarted","Data":"046d7173fd5103f40cea5856f6083381780b52e8d71d300e3ab6288fbdab8063"} Jul 01 16:16:54.591331 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:16:54.591276 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5875f67f46-ltzb2" podStartSLOduration=1.591261067 podStartE2EDuration="1.591261067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:16:54.589478598 +0000 UTC m=+504.788980279" watchObservedRunningTime="2026-07-01 16:16:54.591261067 +0000 UTC m=+504.790762748" Jul 01 16:17:03.658986 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.658952 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:17:03.659453 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.659043 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:17:03.663495 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.663470 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:17:03.745581 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.745554 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc"] Jul 01 16:17:03.749387 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.749367 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.752231 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.752210 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:17:03.752334 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.752298 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cp5ln\"" Jul 01 16:17:03.752606 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.752591 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:17:03.758780 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.758758 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc"] Jul 01 16:17:03.849138 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.849114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.849235 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.849162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.849235 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.849216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9c7\" (UniqueName: \"kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.949937 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.949880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.949937 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.949932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.950088 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.949957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9c7\" (UniqueName: \"kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.950222 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.950202 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.950284 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.950263 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:03.969358 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:03.969330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9c7\" (UniqueName: \"kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:04.060133 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.060114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:04.196518 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.196484 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc"] Jul 01 16:17:04.196945 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:17:04.196919 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3dd2c90_3b93_4bef_bf18_e690053ae027.slice/crio-6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265 WatchSource:0}: Error finding container 6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265: Status 404 returned error can't find the container with id 6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265 Jul 01 16:17:04.521100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.521059 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2"] Jul 01 16:17:04.524681 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.524663 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.534163 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.534142 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2"] Jul 01 16:17:04.627379 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.627356 2583 generic.go:356] "Generic (PLEG): container finished" podID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerID="8cd532ad39838296c66af75f8242205ddbf328a57c050be21919c34fa2faa1a7" exitCode=0 Jul 01 16:17:04.627473 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.627435 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" event={"ID":"b3dd2c90-3b93-4bef-bf18-e690053ae027","Type":"ContainerDied","Data":"8cd532ad39838296c66af75f8242205ddbf328a57c050be21919c34fa2faa1a7"} Jul 01 16:17:04.627524 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.627477 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" event={"ID":"b3dd2c90-3b93-4bef-bf18-e690053ae027","Type":"ContainerStarted","Data":"6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265"} Jul 01 16:17:04.632442 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.632419 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5875f67f46-ltzb2" Jul 01 16:17:04.655087 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.655061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vm8h\" (UniqueName: \"kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.655187 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.655101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.655187 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.655125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.700734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.700706 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:17:04.756128 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.756092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vm8h\" (UniqueName: \"kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.756446 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.756420 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.756665 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.756642 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.757112 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.757087 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.757263 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.757236 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.764659 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.764635 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vm8h\" (UniqueName: \"kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.834563 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.834490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:04.963633 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:04.963560 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2"] Jul 01 16:17:04.968281 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:17:04.968253 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b21e8e5_d268_43dc_888c_aaeaf9d31f98.slice/crio-30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc WatchSource:0}: Error finding container 30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc: Status 404 returned error can't find the container with id 30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc Jul 01 16:17:05.134326 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.134273 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m"] Jul 01 16:17:05.137731 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.137715 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.148568 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.148546 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m"] Jul 01 16:17:05.262577 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.262548 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skk2m\" (UniqueName: \"kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.262679 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.262594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.262679 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.262641 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.363980 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.363942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skk2m\" (UniqueName: \"kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.364113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.364026 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.364113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.364059 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.364418 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.364398 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.364485 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.364400 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.375594 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.375569 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skk2m\" (UniqueName: \"kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.446774 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.446713 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:05.534981 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.534951 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp"] Jul 01 16:17:05.538390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.538370 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.548941 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.548920 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp"] Jul 01 16:17:05.610715 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.610690 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m"] Jul 01 16:17:05.629755 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:17:05.629726 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cbc43b_95fa_4198_8751_1b560867295e.slice/crio-4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d WatchSource:0}: Error finding container 4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d: Status 404 returned error can't find the container with id 4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d Jul 01 16:17:05.634390 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.634366 2583 generic.go:356] "Generic (PLEG): container finished" podID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerID="a896cd1b6947073d3e20b4bd78ec0afd306eb237d086ae746e74cddbf60f33df" exitCode=0 Jul 01 16:17:05.634482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.634455 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" event={"ID":"9b21e8e5-d268-43dc-888c-aaeaf9d31f98","Type":"ContainerDied","Data":"a896cd1b6947073d3e20b4bd78ec0afd306eb237d086ae746e74cddbf60f33df"} Jul 01 16:17:05.634547 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.634508 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" event={"ID":"9b21e8e5-d268-43dc-888c-aaeaf9d31f98","Type":"ContainerStarted","Data":"30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc"} Jul 01 16:17:05.636416 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.636393 2583 generic.go:356] "Generic (PLEG): container finished" podID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerID="d78de3a7b61f4e92f91004fabc0f6dcf4b2920a774d629277d5862483bfb290b" exitCode=0 Jul 01 16:17:05.636500 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.636467 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" event={"ID":"b3dd2c90-3b93-4bef-bf18-e690053ae027","Type":"ContainerDied","Data":"d78de3a7b61f4e92f91004fabc0f6dcf4b2920a774d629277d5862483bfb290b"} Jul 01 16:17:05.666551 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.666525 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.666665 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.666648 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mh9\" (UniqueName: \"kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.666715 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.666695 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.767208 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.767180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.767570 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.767295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.767570 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.767431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mh9\" (UniqueName: \"kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.767688 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.767567 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.767688 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.767649 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.783213 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.783190 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mh9\" (UniqueName: \"kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.849167 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.849144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:05.980115 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:05.980087 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp"] Jul 01 16:17:05.981717 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:17:05.981653 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b185051_83d9_4384_9d58_7190984a78d1.slice/crio-6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51 WatchSource:0}: Error finding container 6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51: Status 404 returned error can't find the container with id 6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51 Jul 01 16:17:06.643930 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.643898 2583 generic.go:356] "Generic (PLEG): container finished" podID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerID="51dabfbedd5cc1d2ae023563b27a782c1d0168c29bb5fa0a57d41a2e36ffb235" exitCode=0 Jul 01 16:17:06.644100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.643992 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" event={"ID":"b3dd2c90-3b93-4bef-bf18-e690053ae027","Type":"ContainerDied","Data":"51dabfbedd5cc1d2ae023563b27a782c1d0168c29bb5fa0a57d41a2e36ffb235"} Jul 01 16:17:06.645433 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.645405 2583 generic.go:356] "Generic (PLEG): container finished" podID="61cbc43b-95fa-4198-8751-1b560867295e" containerID="d4d4dac7d2bcd69636b35f07e9bfe56896636d747f78f1eb36ba2266ac84f095" exitCode=0 Jul 01 16:17:06.645557 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.645483 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" event={"ID":"61cbc43b-95fa-4198-8751-1b560867295e","Type":"ContainerDied","Data":"d4d4dac7d2bcd69636b35f07e9bfe56896636d747f78f1eb36ba2266ac84f095"} Jul 01 16:17:06.645557 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.645519 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" event={"ID":"61cbc43b-95fa-4198-8751-1b560867295e","Type":"ContainerStarted","Data":"4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d"} Jul 01 16:17:06.647136 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.647114 2583 generic.go:356] "Generic (PLEG): container finished" podID="6b185051-83d9-4384-9d58-7190984a78d1" containerID="b6ae5b94cabf747aba96d7422e07f462bb14f69bacd7d773ea4623855746fd3e" exitCode=0 Jul 01 16:17:06.647228 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.647182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" event={"ID":"6b185051-83d9-4384-9d58-7190984a78d1","Type":"ContainerDied","Data":"b6ae5b94cabf747aba96d7422e07f462bb14f69bacd7d773ea4623855746fd3e"} Jul 01 16:17:06.647228 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:06.647214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" event={"ID":"6b185051-83d9-4384-9d58-7190984a78d1","Type":"ContainerStarted","Data":"6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51"} Jul 01 16:17:07.655359 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.655330 2583 generic.go:356] "Generic (PLEG): container finished" podID="61cbc43b-95fa-4198-8751-1b560867295e" containerID="014b4151c19c041a080bc41bd09832eea3888c7339d869e9b186a99af58f5f03" exitCode=0 Jul 01 16:17:07.655745 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.655408 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" event={"ID":"61cbc43b-95fa-4198-8751-1b560867295e","Type":"ContainerDied","Data":"014b4151c19c041a080bc41bd09832eea3888c7339d869e9b186a99af58f5f03"} Jul 01 16:17:07.657260 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.657240 2583 generic.go:356] "Generic (PLEG): container finished" podID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerID="4cd0ddec068f92c28c3d2c46a706e87382917a9411415eaa79b39fd09b0fe58c" exitCode=0 Jul 01 16:17:07.657375 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.657270 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" event={"ID":"9b21e8e5-d268-43dc-888c-aaeaf9d31f98","Type":"ContainerDied","Data":"4cd0ddec068f92c28c3d2c46a706e87382917a9411415eaa79b39fd09b0fe58c"} Jul 01 16:17:07.787594 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.787572 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:07.882674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.882642 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util\") pod \"b3dd2c90-3b93-4bef-bf18-e690053ae027\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " Jul 01 16:17:07.882792 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.882710 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle\") pod \"b3dd2c90-3b93-4bef-bf18-e690053ae027\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " Jul 01 16:17:07.882792 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.882738 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x9c7\" (UniqueName: \"kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7\") pod \"b3dd2c90-3b93-4bef-bf18-e690053ae027\" (UID: \"b3dd2c90-3b93-4bef-bf18-e690053ae027\") " Jul 01 16:17:07.883181 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.883153 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle" (OuterVolumeSpecName: "bundle") pod "b3dd2c90-3b93-4bef-bf18-e690053ae027" (UID: "b3dd2c90-3b93-4bef-bf18-e690053ae027"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:07.884715 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.884690 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7" (OuterVolumeSpecName: "kube-api-access-4x9c7") pod "b3dd2c90-3b93-4bef-bf18-e690053ae027" (UID: "b3dd2c90-3b93-4bef-bf18-e690053ae027"). InnerVolumeSpecName "kube-api-access-4x9c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:07.887807 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.887783 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util" (OuterVolumeSpecName: "util") pod "b3dd2c90-3b93-4bef-bf18-e690053ae027" (UID: "b3dd2c90-3b93-4bef-bf18-e690053ae027"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:07.984373 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.984351 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:07.984445 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.984375 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dd2c90-3b93-4bef-bf18-e690053ae027-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:07.984445 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:07.984388 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x9c7\" (UniqueName: \"kubernetes.io/projected/b3dd2c90-3b93-4bef-bf18-e690053ae027-kube-api-access-4x9c7\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:08.664738 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.664704 2583 generic.go:356] "Generic (PLEG): container finished" podID="61cbc43b-95fa-4198-8751-1b560867295e" containerID="b1d96425d46d8d66b7a9341431c79ad1127cb959292cc78cceb2e804e0fbcc87" exitCode=0 Jul 01 16:17:08.665092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.664792 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" event={"ID":"61cbc43b-95fa-4198-8751-1b560867295e","Type":"ContainerDied","Data":"b1d96425d46d8d66b7a9341431c79ad1127cb959292cc78cceb2e804e0fbcc87"} Jul 01 16:17:08.666615 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.666592 2583 generic.go:356] "Generic (PLEG): container finished" podID="6b185051-83d9-4384-9d58-7190984a78d1" containerID="312fb1abe05f9ffbb30604b4a22f4ca44c7057211210eeeb732982fc2849cafe" exitCode=0 Jul 01 16:17:08.666709 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.666684 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" event={"ID":"6b185051-83d9-4384-9d58-7190984a78d1","Type":"ContainerDied","Data":"312fb1abe05f9ffbb30604b4a22f4ca44c7057211210eeeb732982fc2849cafe"} Jul 01 16:17:08.668920 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.668900 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" Jul 01 16:17:08.669011 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.668927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc" event={"ID":"b3dd2c90-3b93-4bef-bf18-e690053ae027","Type":"ContainerDied","Data":"6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265"} Jul 01 16:17:08.669011 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.668969 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e487ebaf503bdb9f5e78e9f0ce3fe30a89ba92b8d3b907c29df7e7a7af63265" Jul 01 16:17:08.671251 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.671213 2583 generic.go:356] "Generic (PLEG): container finished" podID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerID="38ee44d5ef71f81177104ca9d91e0826af566e6309e981072d1a6e71fa6ad07e" exitCode=0 Jul 01 16:17:08.671346 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:08.671256 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" event={"ID":"9b21e8e5-d268-43dc-888c-aaeaf9d31f98","Type":"ContainerDied","Data":"38ee44d5ef71f81177104ca9d91e0826af566e6309e981072d1a6e71fa6ad07e"} Jul 01 16:17:09.679748 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:09.679707 2583 generic.go:356] "Generic (PLEG): container finished" podID="6b185051-83d9-4384-9d58-7190984a78d1" containerID="ffb3cb777df6e9f5202e7e6905013433a4af5df8616a9f1d771f5fe0e16ccbb6" exitCode=0 Jul 01 16:17:09.680224 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:09.679773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" event={"ID":"6b185051-83d9-4384-9d58-7190984a78d1","Type":"ContainerDied","Data":"ffb3cb777df6e9f5202e7e6905013433a4af5df8616a9f1d771f5fe0e16ccbb6"} Jul 01 16:17:09.835326 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:09.835300 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:09.838103 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:09.838082 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:10.000409 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000380 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle\") pod \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " Jul 01 16:17:10.000549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000439 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vm8h\" (UniqueName: \"kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h\") pod \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " Jul 01 16:17:10.000549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000465 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util\") pod \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\" (UID: \"9b21e8e5-d268-43dc-888c-aaeaf9d31f98\") " Jul 01 16:17:10.000549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000495 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle\") pod \"61cbc43b-95fa-4198-8751-1b560867295e\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " Jul 01 16:17:10.000549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000526 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skk2m\" (UniqueName: \"kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m\") pod \"61cbc43b-95fa-4198-8751-1b560867295e\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " Jul 01 16:17:10.000549 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.000543 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util\") pod \"61cbc43b-95fa-4198-8751-1b560867295e\" (UID: \"61cbc43b-95fa-4198-8751-1b560867295e\") " Jul 01 16:17:10.001143 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.001111 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle" (OuterVolumeSpecName: "bundle") pod "9b21e8e5-d268-43dc-888c-aaeaf9d31f98" (UID: "9b21e8e5-d268-43dc-888c-aaeaf9d31f98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:10.001249 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.001197 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle" (OuterVolumeSpecName: "bundle") pod "61cbc43b-95fa-4198-8751-1b560867295e" (UID: "61cbc43b-95fa-4198-8751-1b560867295e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:10.002734 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.002706 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h" (OuterVolumeSpecName: "kube-api-access-7vm8h") pod "9b21e8e5-d268-43dc-888c-aaeaf9d31f98" (UID: "9b21e8e5-d268-43dc-888c-aaeaf9d31f98"). InnerVolumeSpecName "kube-api-access-7vm8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:10.002822 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.002761 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m" (OuterVolumeSpecName: "kube-api-access-skk2m") pod "61cbc43b-95fa-4198-8751-1b560867295e" (UID: "61cbc43b-95fa-4198-8751-1b560867295e"). InnerVolumeSpecName "kube-api-access-skk2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:10.009481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.009455 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util" (OuterVolumeSpecName: "util") pod "9b21e8e5-d268-43dc-888c-aaeaf9d31f98" (UID: "9b21e8e5-d268-43dc-888c-aaeaf9d31f98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:10.009570 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.009558 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util" (OuterVolumeSpecName: "util") pod "61cbc43b-95fa-4198-8751-1b560867295e" (UID: "61cbc43b-95fa-4198-8751-1b560867295e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:10.102051 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102030 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.102051 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102050 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skk2m\" (UniqueName: \"kubernetes.io/projected/61cbc43b-95fa-4198-8751-1b560867295e-kube-api-access-skk2m\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.102163 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102060 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61cbc43b-95fa-4198-8751-1b560867295e-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.102163 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102068 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.102163 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102076 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vm8h\" (UniqueName: \"kubernetes.io/projected/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-kube-api-access-7vm8h\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.102163 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.102084 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b21e8e5-d268-43dc-888c-aaeaf9d31f98-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:10.687113 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.687084 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" Jul 01 16:17:10.687483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.687115 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m" event={"ID":"61cbc43b-95fa-4198-8751-1b560867295e","Type":"ContainerDied","Data":"4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d"} Jul 01 16:17:10.687483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.687160 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aa654797e9256d0da8fc447b9d014737bb1cea5e6c62e499ebda01ab656e91d" Jul 01 16:17:10.689196 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.689165 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" event={"ID":"9b21e8e5-d268-43dc-888c-aaeaf9d31f98","Type":"ContainerDied","Data":"30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc"} Jul 01 16:17:10.689359 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.689215 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30656a70250948534ddeaeaabbb4f900836ca49161647567a117f5e8c444fecc" Jul 01 16:17:10.689784 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.689574 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2" Jul 01 16:17:10.834142 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:10.834121 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:11.009609 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.009578 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7mh9\" (UniqueName: \"kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9\") pod \"6b185051-83d9-4384-9d58-7190984a78d1\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " Jul 01 16:17:11.009749 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.009648 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle\") pod \"6b185051-83d9-4384-9d58-7190984a78d1\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " Jul 01 16:17:11.009749 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.009683 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util\") pod \"6b185051-83d9-4384-9d58-7190984a78d1\" (UID: \"6b185051-83d9-4384-9d58-7190984a78d1\") " Jul 01 16:17:11.010265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.010231 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle" (OuterVolumeSpecName: "bundle") pod "6b185051-83d9-4384-9d58-7190984a78d1" (UID: "6b185051-83d9-4384-9d58-7190984a78d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:11.011713 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.011687 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9" (OuterVolumeSpecName: "kube-api-access-h7mh9") pod "6b185051-83d9-4384-9d58-7190984a78d1" (UID: "6b185051-83d9-4384-9d58-7190984a78d1"). InnerVolumeSpecName "kube-api-access-h7mh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:11.015343 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.015318 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util" (OuterVolumeSpecName: "util") pod "6b185051-83d9-4384-9d58-7190984a78d1" (UID: "6b185051-83d9-4384-9d58-7190984a78d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:11.110697 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.110674 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7mh9\" (UniqueName: \"kubernetes.io/projected/6b185051-83d9-4384-9d58-7190984a78d1-kube-api-access-h7mh9\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:11.110697 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.110695 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:11.110818 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.110705 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b185051-83d9-4384-9d58-7190984a78d1-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:11.697296 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.697274 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" Jul 01 16:17:11.697652 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.697336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp" event={"ID":"6b185051-83d9-4384-9d58-7190984a78d1","Type":"ContainerDied","Data":"6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51"} Jul 01 16:17:11.697652 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:11.697385 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a194f13d4888db3c414ee2a728442ffed4b365ab4e61c7da046f8f3655a9d51" Jul 01 16:17:11.739496 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:17:11.739469 2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b185051_83d9_4384_9d58_7190984a78d1.slice\": RecentStats: unable to find data in memory cache]" Jul 01 16:17:29.721297 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:29.721192 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67b78ffc7f-bl56h" podUID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" containerName="console" containerID="cri-o://ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa" gracePeriod=15 Jul 01 16:17:29.961244 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:29.961220 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:17:30.057961 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.057897 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.057961 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.057939 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.057971 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fs5d\" (UniqueName: \"kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.057998 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058027 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058056 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058134 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058101 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config\") pod \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\" (UID: \"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822\") " Jul 01 16:17:30.058467 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058434 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:17:30.058579 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058442 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca" (OuterVolumeSpecName: "service-ca") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:17:30.058579 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058470 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:17:30.058579 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.058527 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config" (OuterVolumeSpecName: "console-config") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:17:30.060120 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.060096 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d" (OuterVolumeSpecName: "kube-api-access-8fs5d") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "kube-api-access-8fs5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:30.060211 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.060159 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:17:30.060473 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.060448 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" (UID: "df6d00f5-c5d3-4c59-a828-8c7cbc0a9822"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:17:30.159565 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159525 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159565 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159560 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-oauth-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159565 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159570 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fs5d\" (UniqueName: \"kubernetes.io/projected/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-kube-api-access-8fs5d\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159580 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-oauth-serving-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159589 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-service-ca\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159598 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-trusted-ca-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.159794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.159607 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822-console-config\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:17:30.799100 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.799054 2583 generic.go:356] "Generic (PLEG): container finished" podID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" containerID="ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa" exitCode=0 Jul 01 16:17:30.799490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.799107 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b78ffc7f-bl56h" Jul 01 16:17:30.799490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.799159 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b78ffc7f-bl56h" event={"ID":"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822","Type":"ContainerDied","Data":"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa"} Jul 01 16:17:30.799490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.799208 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b78ffc7f-bl56h" event={"ID":"df6d00f5-c5d3-4c59-a828-8c7cbc0a9822","Type":"ContainerDied","Data":"a887b31a93f102d4268c50425c223250addee32c403136f47983d1be93298fe1"} Jul 01 16:17:30.799490 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.799239 2583 scope.go:117] "RemoveContainer" containerID="ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa" Jul 01 16:17:30.809481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.809455 2583 scope.go:117] "RemoveContainer" containerID="ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa" Jul 01 16:17:30.809864 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:17:30.809803 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa\": container with ID starting with ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa not found: ID does not exist" containerID="ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa" Jul 01 16:17:30.809944 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.809885 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa"} err="failed to get container status \"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa\": rpc error: code = NotFound desc = could not find container \"ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa\": container with ID starting with ee068e780b4257031593182a0a9a8487dd2406700e8a569f1fbe22a56f23d0fa not found: ID does not exist" Jul 01 16:17:30.842680 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.842638 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:17:30.870946 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:30.870907 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b78ffc7f-bl56h"] Jul 01 16:17:32.167602 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:32.167564 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" path="/var/lib/kubelet/pods/df6d00f5-c5d3-4c59-a828-8c7cbc0a9822/volumes" Jul 01 16:17:49.628380 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628346 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n"] Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628710 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="pull" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628721 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="pull" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628735 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628740 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628747 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628752 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628760 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628768 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="util" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628784 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" containerName="console" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628789 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" containerName="console" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628796 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="extract" Jul 01 16:17:49.628794 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628801 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628808 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628813 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628818 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628823 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628831 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="util" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628860 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="util" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628870 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628876 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628882 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628887 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628892 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628897 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628904 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628908 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="pull" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628972 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b21e8e5-d268-43dc-888c-aaeaf9d31f98" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628982 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6d00f5-c5d3-4c59-a828-8c7cbc0a9822" containerName="console" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628988 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cbc43b-95fa-4198-8751-1b560867295e" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.628994 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3dd2c90-3b93-4bef-bf18-e690053ae027" containerName="extract" Jul 01 16:17:49.629199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.629002 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b185051-83d9-4384-9d58-7190984a78d1" containerName="extract" Jul 01 16:17:49.633874 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.633850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:49.638096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.638076 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:17:49.638096 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.638085 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:17:49.639426 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.639406 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-46xzf\"" Jul 01 16:17:49.651492 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.651470 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n"] Jul 01 16:17:49.736321 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.736297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjf58\" (UniqueName: \"kubernetes.io/projected/01d921bf-671c-4085-bfb0-4658ab8693c9-kube-api-access-wjf58\") pod \"limitador-operator-controller-manager-859d7b78bd-w5q9n\" (UID: \"01d921bf-671c-4085-bfb0-4658ab8693c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:49.837202 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.837179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjf58\" (UniqueName: \"kubernetes.io/projected/01d921bf-671c-4085-bfb0-4658ab8693c9-kube-api-access-wjf58\") pod \"limitador-operator-controller-manager-859d7b78bd-w5q9n\" (UID: \"01d921bf-671c-4085-bfb0-4658ab8693c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:49.857947 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.857926 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjf58\" (UniqueName: \"kubernetes.io/projected/01d921bf-671c-4085-bfb0-4658ab8693c9-kube-api-access-wjf58\") pod \"limitador-operator-controller-manager-859d7b78bd-w5q9n\" (UID: \"01d921bf-671c-4085-bfb0-4658ab8693c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:49.945087 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:49.944999 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:50.080964 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:50.080834 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n"] Jul 01 16:17:50.083454 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:17:50.083427 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d921bf_671c_4085_bfb0_4658ab8693c9.slice/crio-7f9add5ac1c95fee55cd82b81298340c223b534c0e636388619fce7bbcaa56e6 WatchSource:0}: Error finding container 7f9add5ac1c95fee55cd82b81298340c223b534c0e636388619fce7bbcaa56e6: Status 404 returned error can't find the container with id 7f9add5ac1c95fee55cd82b81298340c223b534c0e636388619fce7bbcaa56e6 Jul 01 16:17:50.910423 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:50.910372 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" event={"ID":"01d921bf-671c-4085-bfb0-4658ab8693c9","Type":"ContainerStarted","Data":"7f9add5ac1c95fee55cd82b81298340c223b534c0e636388619fce7bbcaa56e6"} Jul 01 16:17:52.922161 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:52.922114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" event={"ID":"01d921bf-671c-4085-bfb0-4658ab8693c9","Type":"ContainerStarted","Data":"d4483f10c0a603d4ec3ed44a68c39968953c3ee052abaedea6c35ad077dcefcb"} Jul 01 16:17:52.922535 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:52.922179 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:17:52.948767 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:17:52.948722 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" podStartSLOduration=1.230012288 podStartE2EDuration="3.948707823s" totalImagesPullingTime="2.718695535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:52.945989316 +0000 UTC m=+563.145490998" watchObservedRunningTime="2026-07-01 16:17:52.948707823 +0000 UTC m=+563.148209504" Jul 01 16:18:03.929577 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:18:03.929546 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5q9n" Jul 01 16:18:30.148997 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:18:30.148968 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:18:30.149966 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:18:30.149941 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:18:30.152439 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:18:30.152419 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:18:30.153403 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:18:30.153386 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:19:02.587661 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.587584 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2"] Jul 01 16:19:02.591061 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.591045 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.594029 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.594008 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:19:02.595150 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.595134 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2hzll\"" Jul 01 16:19:02.595199 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.595134 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:19:02.600957 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.600935 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2"] Jul 01 16:19:02.690166 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.690138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.690265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.690173 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j855j\" (UniqueName: \"kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.690265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.690206 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.790965 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.790929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.791092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.790969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j855j\" (UniqueName: \"kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.791092 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.791006 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.791325 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.791307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.791388 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.791307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.801227 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.801208 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j855j\" (UniqueName: \"kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:02.901361 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:02.901311 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:03.026695 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:03.026671 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2"] Jul 01 16:19:03.028322 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:19:03.028294 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefedc6e1_65bf_4564_86be_ff31124d8107.slice/crio-515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60 WatchSource:0}: Error finding container 515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60: Status 404 returned error can't find the container with id 515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60 Jul 01 16:19:03.298502 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:03.298473 2583 generic.go:356] "Generic (PLEG): container finished" podID="efedc6e1-65bf-4564-86be-ff31124d8107" containerID="64ccabd5ab92aab05c1c51a3826e89dc66817262ac11c5d91d68bad758fd2558" exitCode=0 Jul 01 16:19:03.298619 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:03.298528 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" event={"ID":"efedc6e1-65bf-4564-86be-ff31124d8107","Type":"ContainerDied","Data":"64ccabd5ab92aab05c1c51a3826e89dc66817262ac11c5d91d68bad758fd2558"} Jul 01 16:19:03.298619 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:03.298579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" event={"ID":"efedc6e1-65bf-4564-86be-ff31124d8107","Type":"ContainerStarted","Data":"515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60"} Jul 01 16:19:03.299533 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:03.299512 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:19:04.305775 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:04.305745 2583 generic.go:356] "Generic (PLEG): container finished" podID="efedc6e1-65bf-4564-86be-ff31124d8107" containerID="52719aaf088f8ec30d38a6b384101e987372d130f4d569af50126db5778cb7a3" exitCode=0 Jul 01 16:19:04.306094 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:04.305861 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" event={"ID":"efedc6e1-65bf-4564-86be-ff31124d8107","Type":"ContainerDied","Data":"52719aaf088f8ec30d38a6b384101e987372d130f4d569af50126db5778cb7a3"} Jul 01 16:19:05.313243 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:05.313210 2583 generic.go:356] "Generic (PLEG): container finished" podID="efedc6e1-65bf-4564-86be-ff31124d8107" containerID="d63353f09a4a2560d958b95729dc5e8dd513c8c0383208f0d616edb7a6190188" exitCode=0 Jul 01 16:19:05.313599 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:05.313285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" event={"ID":"efedc6e1-65bf-4564-86be-ff31124d8107","Type":"ContainerDied","Data":"d63353f09a4a2560d958b95729dc5e8dd513c8c0383208f0d616edb7a6190188"} Jul 01 16:19:06.446883 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.446860 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:06.519129 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.519103 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util\") pod \"efedc6e1-65bf-4564-86be-ff31124d8107\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " Jul 01 16:19:06.519231 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.519142 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle\") pod \"efedc6e1-65bf-4564-86be-ff31124d8107\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " Jul 01 16:19:06.519231 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.519162 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j855j\" (UniqueName: \"kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j\") pod \"efedc6e1-65bf-4564-86be-ff31124d8107\" (UID: \"efedc6e1-65bf-4564-86be-ff31124d8107\") " Jul 01 16:19:06.519621 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.519598 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle" (OuterVolumeSpecName: "bundle") pod "efedc6e1-65bf-4564-86be-ff31124d8107" (UID: "efedc6e1-65bf-4564-86be-ff31124d8107"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:19:06.521103 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.521080 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j" (OuterVolumeSpecName: "kube-api-access-j855j") pod "efedc6e1-65bf-4564-86be-ff31124d8107" (UID: "efedc6e1-65bf-4564-86be-ff31124d8107"). InnerVolumeSpecName "kube-api-access-j855j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:19:06.524486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.524455 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util" (OuterVolumeSpecName: "util") pod "efedc6e1-65bf-4564-86be-ff31124d8107" (UID: "efedc6e1-65bf-4564-86be-ff31124d8107"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:19:06.620121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.620072 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-util\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:19:06.620121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.620093 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efedc6e1-65bf-4564-86be-ff31124d8107-bundle\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:19:06.620121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:06.620103 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j855j\" (UniqueName: \"kubernetes.io/projected/efedc6e1-65bf-4564-86be-ff31124d8107-kube-api-access-j855j\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:19:07.324694 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:07.324662 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" event={"ID":"efedc6e1-65bf-4564-86be-ff31124d8107","Type":"ContainerDied","Data":"515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60"} Jul 01 16:19:07.324694 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:07.324681 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82ssx2" Jul 01 16:19:07.324874 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:19:07.324704 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="515ecdc03d48a381648b091904381d437aa66b49ed041916239227783c625e60" Jul 01 16:20:02.757595 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757562 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757925 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="pull" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757938 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="pull" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757958 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="util" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757963 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="util" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757972 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="extract" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.757977 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="extract" Jul 01 16:20:02.758079 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.758029 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="efedc6e1-65bf-4564-86be-ff31124d8107" containerName="extract" Jul 01 16:20:02.761073 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.761055 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.763919 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.763898 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 16:20:02.763919 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.763915 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w72c2\"" Jul 01 16:20:02.764091 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.763929 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 16:20:02.770063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.770041 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:02.829633 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.829605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.829736 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.829669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7wc\" (UniqueName: \"kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.930606 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.930577 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.930726 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.930664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7wc\" (UniqueName: \"kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.930777 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:20:02.930716 2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 16:20:02.930813 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:20:02.930794 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert podName:640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7 nodeName:}" failed. No retries permitted until 2026-07-01 16:20:03.430776117 +0000 UTC m=+693.630277778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert") pod "maas-controller-787755d7f-z5cgc" (UID: "640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7") : secret "maas-controller-webhook-cert" not found Jul 01 16:20:02.941022 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.940995 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64d8659ff-6488v"] Jul 01 16:20:02.943167 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.943146 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7wc\" (UniqueName: \"kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:02.951030 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.951004 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:02.954054 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:02.954035 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64d8659ff-6488v"] Jul 01 16:20:03.031706 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.031655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2792a82-6d10-42cd-8677-c724af5438f8-webhook-cert\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.031803 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.031708 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblpf\" (UniqueName: \"kubernetes.io/projected/a2792a82-6d10-42cd-8677-c724af5438f8-kube-api-access-fblpf\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.132393 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.132371 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblpf\" (UniqueName: \"kubernetes.io/projected/a2792a82-6d10-42cd-8677-c724af5438f8-kube-api-access-fblpf\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.132489 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.132435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2792a82-6d10-42cd-8677-c724af5438f8-webhook-cert\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.134756 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.134739 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2792a82-6d10-42cd-8677-c724af5438f8-webhook-cert\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.144150 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.144122 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblpf\" (UniqueName: \"kubernetes.io/projected/a2792a82-6d10-42cd-8677-c724af5438f8-kube-api-access-fblpf\") pod \"maas-controller-64d8659ff-6488v\" (UID: \"a2792a82-6d10-42cd-8677-c724af5438f8\") " pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.262108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.262086 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:03.387227 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.387203 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64d8659ff-6488v"] Jul 01 16:20:03.388972 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:20:03.388942 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2792a82_6d10_42cd_8677_c724af5438f8.slice/crio-c9097eb27d3f38b9e6e5f681458695ca6909b70766016cd02e1a95b3327e7efa WatchSource:0}: Error finding container c9097eb27d3f38b9e6e5f681458695ca6909b70766016cd02e1a95b3327e7efa: Status 404 returned error can't find the container with id c9097eb27d3f38b9e6e5f681458695ca6909b70766016cd02e1a95b3327e7efa Jul 01 16:20:03.435101 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.435074 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:03.437203 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.437184 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") pod \"maas-controller-787755d7f-z5cgc\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:03.627639 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.627575 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64d8659ff-6488v" event={"ID":"a2792a82-6d10-42cd-8677-c724af5438f8","Type":"ContainerStarted","Data":"c9097eb27d3f38b9e6e5f681458695ca6909b70766016cd02e1a95b3327e7efa"} Jul 01 16:20:03.672296 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.672275 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:03.800991 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:03.800967 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:03.802232 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:20:03.802208 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640c8ee5_63c7_4956_ab00_ecb8e7bfb0e7.slice/crio-bf8c0fc856707bdb53b46af19eb750b1e360f61185347e89e7ad2bcf834a102d WatchSource:0}: Error finding container bf8c0fc856707bdb53b46af19eb750b1e360f61185347e89e7ad2bcf834a102d: Status 404 returned error can't find the container with id bf8c0fc856707bdb53b46af19eb750b1e360f61185347e89e7ad2bcf834a102d Jul 01 16:20:04.638221 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:04.638177 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-z5cgc" event={"ID":"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7","Type":"ContainerStarted","Data":"bf8c0fc856707bdb53b46af19eb750b1e360f61185347e89e7ad2bcf834a102d"} Jul 01 16:20:06.653111 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.653076 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64d8659ff-6488v" event={"ID":"a2792a82-6d10-42cd-8677-c724af5438f8","Type":"ContainerStarted","Data":"5d47288e5b67f506a86b53cba074f1f10f83652e598e7b828a64c6b6d9e8e8e4"} Jul 01 16:20:06.653532 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.653173 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:06.654892 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.654817 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-z5cgc" event={"ID":"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7","Type":"ContainerStarted","Data":"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51"} Jul 01 16:20:06.655121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.655078 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:06.698974 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.698885 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64d8659ff-6488v" podStartSLOduration=1.646138256 podStartE2EDuration="4.698868658s" totalImagesPullingTime="3.052730402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:06.697999901 +0000 UTC m=+696.897501581" watchObservedRunningTime="2026-07-01 16:20:06.698868658 +0000 UTC m=+696.898370344" Jul 01 16:20:06.743415 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:06.743378 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-787755d7f-z5cgc" podStartSLOduration=2.097420184 podStartE2EDuration="4.74336658s" totalImagesPullingTime="2.645946396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:06.740113926 +0000 UTC m=+696.939615605" watchObservedRunningTime="2026-07-01 16:20:06.74336658 +0000 UTC m=+696.942868258" Jul 01 16:20:17.666712 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:17.666681 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64d8659ff-6488v" Jul 01 16:20:17.667191 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:17.666749 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:17.736764 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:17.736726 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:17.737143 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:17.737115 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-787755d7f-z5cgc" podUID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" containerName="manager" containerID="cri-o://5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51" gracePeriod=30 Jul 01 16:20:17.979265 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:17.979240 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:18.053384 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.053353 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") pod \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " Jul 01 16:20:18.053518 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.053423 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh7wc\" (UniqueName: \"kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc\") pod \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\" (UID: \"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7\") " Jul 01 16:20:18.055448 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.055417 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" (UID: "640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:20:18.055543 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.055498 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc" (OuterVolumeSpecName: "kube-api-access-gh7wc") pod "640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" (UID: "640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7"). InnerVolumeSpecName "kube-api-access-gh7wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:20:18.154148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.154117 2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-webhook-cert\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:20:18.154148 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.154144 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh7wc\" (UniqueName: \"kubernetes.io/projected/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7-kube-api-access-gh7wc\") on node \"ip-10-0-140-101.ec2.internal\" DevicePath \"\"" Jul 01 16:20:18.734486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.734459 2583 generic.go:356] "Generic (PLEG): container finished" podID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" containerID="5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51" exitCode=0 Jul 01 16:20:18.734814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.734501 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-787755d7f-z5cgc" Jul 01 16:20:18.734814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.734534 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-z5cgc" event={"ID":"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7","Type":"ContainerDied","Data":"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51"} Jul 01 16:20:18.734814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.734574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-787755d7f-z5cgc" event={"ID":"640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7","Type":"ContainerDied","Data":"bf8c0fc856707bdb53b46af19eb750b1e360f61185347e89e7ad2bcf834a102d"} Jul 01 16:20:18.734814 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.734596 2583 scope.go:117] "RemoveContainer" containerID="5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51" Jul 01 16:20:18.743342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.743199 2583 scope.go:117] "RemoveContainer" containerID="5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51" Jul 01 16:20:18.743459 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:20:18.743437 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51\": container with ID starting with 5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51 not found: ID does not exist" containerID="5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51" Jul 01 16:20:18.743501 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.743473 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51"} err="failed to get container status \"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51\": rpc error: code = NotFound desc = could not find container \"5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51\": container with ID starting with 5e78933e5bfcd3b3d5816d917e3032c3de1e8a6fb9be7a78be72665771883b51 not found: ID does not exist" Jul 01 16:20:18.754097 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.754073 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:18.758240 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:18.758222 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-787755d7f-z5cgc"] Jul 01 16:20:20.167348 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:20.167315 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" path="/var/lib/kubelet/pods/640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7/volumes" Jul 01 16:20:38.751465 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.751432 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-858675456-mgfhq"] Jul 01 16:20:38.751927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.751855 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" containerName="manager" Jul 01 16:20:38.751927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.751869 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" containerName="manager" Jul 01 16:20:38.751927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.751926 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="640c8ee5-63c7-4956-ab00-ecb8e7bfb0e7" containerName="manager" Jul 01 16:20:38.756263 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.756248 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:38.760806 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.760785 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 01 16:20:38.760967 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.760948 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2pzjf\"" Jul 01 16:20:38.761248 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.761230 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 01 16:20:38.762291 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.762268 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 01 16:20:38.776465 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.776437 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858675456-mgfhq"] Jul 01 16:20:38.913015 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.912982 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-openshift-service-ca\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:38.913173 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.913030 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgb5g\" (UniqueName: \"kubernetes.io/projected/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-kube-api-access-mgb5g\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:38.913173 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:38.913124 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.013787 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.013711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-openshift-service-ca\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.013787 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.013761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgb5g\" (UniqueName: \"kubernetes.io/projected/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-kube-api-access-mgb5g\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.014036 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.013816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.014036 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:20:39.013954 2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 16:20:39.014036 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:20:39.014025 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls podName:0c64bb87-aff6-4c12-86c3-480b2ffdc9f6 nodeName:}" failed. No retries permitted until 2026-07-01 16:20:39.514003674 +0000 UTC m=+729.713505352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls") pod "maas-api-858675456-mgfhq" (UID: "0c64bb87-aff6-4c12-86c3-480b2ffdc9f6") : secret "maas-api-serving-cert" not found Jul 01 16:20:39.014468 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.014449 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-openshift-service-ca\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.025334 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.025310 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgb5g\" (UniqueName: \"kubernetes.io/projected/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-kube-api-access-mgb5g\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.422660 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.422587 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9"] Jul 01 16:20:39.427666 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.427646 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.430707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.430687 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 16:20:39.430812 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.430744 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k5gqv\"" Jul 01 16:20:39.437609 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.437588 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9"] Jul 01 16:20:39.500155 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.500131 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mtmgw"] Jul 01 16:20:39.505194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.505173 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.512627 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.512605 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mtmgw"] Jul 01 16:20:39.517027 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.517003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.517129 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.517044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnc9b\" (UniqueName: \"kubernetes.io/projected/575044e4-adb1-4e3a-8ac7-15a349bc4870-kube-api-access-rnc9b\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.517129 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.517088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/575044e4-adb1-4e3a-8ac7-15a349bc4870-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.519363 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.519341 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c64bb87-aff6-4c12-86c3-480b2ffdc9f6-maas-api-tls\") pod \"maas-api-858675456-mgfhq\" (UID: \"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6\") " pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.618316 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.618291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2rp\" (UniqueName: \"kubernetes.io/projected/8750e0f4-3561-44a8-82f2-7dd468279239-kube-api-access-gd2rp\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.618427 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.618335 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/575044e4-adb1-4e3a-8ac7-15a349bc4870-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.618491 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.618453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8750e0f4-3561-44a8-82f2-7dd468279239-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.618551 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.618494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnc9b\" (UniqueName: \"kubernetes.io/projected/575044e4-adb1-4e3a-8ac7-15a349bc4870-kube-api-access-rnc9b\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.619128 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.619106 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/575044e4-adb1-4e3a-8ac7-15a349bc4870-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.628481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.628460 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnc9b\" (UniqueName: \"kubernetes.io/projected/575044e4-adb1-4e3a-8ac7-15a349bc4870-kube-api-access-rnc9b\") pod \"payload-pre-processing-59f49fd4f6-cdmr9\" (UID: \"575044e4-adb1-4e3a-8ac7-15a349bc4870\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.666250 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.666227 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:39.719759 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.719582 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8750e0f4-3561-44a8-82f2-7dd468279239-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.719759 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.719662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2rp\" (UniqueName: \"kubernetes.io/projected/8750e0f4-3561-44a8-82f2-7dd468279239-kube-api-access-gd2rp\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.720552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.720524 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8750e0f4-3561-44a8-82f2-7dd468279239-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.729108 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.729064 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2rp\" (UniqueName: \"kubernetes.io/projected/8750e0f4-3561-44a8-82f2-7dd468279239-kube-api-access-gd2rp\") pod \"payload-processing-7bbcb654f4-mtmgw\" (UID: \"8750e0f4-3561-44a8-82f2-7dd468279239\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.739574 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.739554 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:39.807284 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.807246 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858675456-mgfhq"] Jul 01 16:20:39.808240 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:20:39.808210 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c64bb87_aff6_4c12_86c3_480b2ffdc9f6.slice/crio-3096d9ef4c93d70b3de868df77d8879c58267fffb0723967ae63c89b6a8aa4fa WatchSource:0}: Error finding container 3096d9ef4c93d70b3de868df77d8879c58267fffb0723967ae63c89b6a8aa4fa: Status 404 returned error can't find the container with id 3096d9ef4c93d70b3de868df77d8879c58267fffb0723967ae63c89b6a8aa4fa Jul 01 16:20:39.816901 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.816871 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:39.844432 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.844402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" event={"ID":"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6","Type":"ContainerStarted","Data":"3096d9ef4c93d70b3de868df77d8879c58267fffb0723967ae63c89b6a8aa4fa"} Jul 01 16:20:39.879301 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:20:39.879270 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575044e4_adb1_4e3a_8ac7_15a349bc4870.slice/crio-8844951c18cdc959e3e285d526482ea30a8e438d53c6ac0f67793cf386b843ff WatchSource:0}: Error finding container 8844951c18cdc959e3e285d526482ea30a8e438d53c6ac0f67793cf386b843ff: Status 404 returned error can't find the container with id 8844951c18cdc959e3e285d526482ea30a8e438d53c6ac0f67793cf386b843ff Jul 01 16:20:39.880107 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.880077 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9"] Jul 01 16:20:39.988132 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:39.988104 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mtmgw"] Jul 01 16:20:39.989616 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:20:39.989587 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8750e0f4_3561_44a8_82f2_7dd468279239.slice/crio-22042d5c351decbdba75f72409172b14ceb75c9385fe1d2e5181889afe36f062 WatchSource:0}: Error finding container 22042d5c351decbdba75f72409172b14ceb75c9385fe1d2e5181889afe36f062: Status 404 returned error can't find the container with id 22042d5c351decbdba75f72409172b14ceb75c9385fe1d2e5181889afe36f062 Jul 01 16:20:40.854674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:40.854630 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerStarted","Data":"22042d5c351decbdba75f72409172b14ceb75c9385fe1d2e5181889afe36f062"} Jul 01 16:20:40.856693 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:40.856623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" event={"ID":"575044e4-adb1-4e3a-8ac7-15a349bc4870","Type":"ContainerStarted","Data":"8844951c18cdc959e3e285d526482ea30a8e438d53c6ac0f67793cf386b843ff"} Jul 01 16:20:42.870752 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.870657 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" event={"ID":"0c64bb87-aff6-4c12-86c3-480b2ffdc9f6","Type":"ContainerStarted","Data":"5f45891201175332c80552c792b28e4ad838ade69bd553c402a212a41b9eb097"} Jul 01 16:20:42.871225 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.870784 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:42.872209 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.872187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerStarted","Data":"62e1bacd4b5ef84a6f290377771b3760aec04223e448ab2430f999e9ff37c3e7"} Jul 01 16:20:42.872342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.872308 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:42.873615 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.873597 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" event={"ID":"575044e4-adb1-4e3a-8ac7-15a349bc4870","Type":"ContainerStarted","Data":"56e613100e9bb0778c999e48c4314e4ced8fe3b9020378f98b1d2a21c4c58a87"} Jul 01 16:20:42.873722 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.873709 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:20:42.892176 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.892138 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" podStartSLOduration=2.102468324 podStartE2EDuration="4.892126276s" totalImagesPullingTime="2.789657952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:42.889856871 +0000 UTC m=+733.089358543" watchObservedRunningTime="2026-07-01 16:20:42.892126276 +0000 UTC m=+733.091627956" Jul 01 16:20:42.907491 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.907455 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" podStartSLOduration=1.17880523 podStartE2EDuration="3.90744198s" totalImagesPullingTime="2.72863675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:42.906914085 +0000 UTC m=+733.106415765" watchObservedRunningTime="2026-07-01 16:20:42.90744198 +0000 UTC m=+733.106943658" Jul 01 16:20:42.924927 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:42.924890 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" podStartSLOduration=1.316544103 podStartE2EDuration="3.924880253s" totalImagesPullingTime="2.60833615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:42.924224988 +0000 UTC m=+733.123726669" watchObservedRunningTime="2026-07-01 16:20:42.924880253 +0000 UTC m=+733.124381932" Jul 01 16:20:48.884482 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:48.884453 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-858675456-mgfhq" Jul 01 16:20:53.881959 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:53.881917 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:20:53.882467 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:20:53.882008 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-cdmr9" Jul 01 16:21:40.306176 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.306144 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69"] Jul 01 16:21:40.309658 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.309639 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.314306 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.314279 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:21:40.314450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.314281 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 16:21:40.314450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.314285 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jwztp\"" Jul 01 16:21:40.314450 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.314331 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:21:40.322472 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.322442 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69"] Jul 01 16:21:40.386748 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.386724 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.386911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.386764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.386911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.386792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.386911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.386826 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb75a895-10f2-4a54-a647-8bf7378acdc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.386911 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.386877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9929\" (UniqueName: \"kubernetes.io/projected/eb75a895-10f2-4a54-a647-8bf7378acdc0-kube-api-access-k9929\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488240 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488355 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488355 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488355 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb75a895-10f2-4a54-a647-8bf7378acdc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488493 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9929\" (UniqueName: \"kubernetes.io/projected/eb75a895-10f2-4a54-a647-8bf7378acdc0-kube-api-access-k9929\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488745 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488719 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.488869 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.488752 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.490278 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.490257 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb75a895-10f2-4a54-a647-8bf7378acdc0-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.490629 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.490610 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb75a895-10f2-4a54-a647-8bf7378acdc0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.497680 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.497658 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9929\" (UniqueName: \"kubernetes.io/projected/eb75a895-10f2-4a54-a647-8bf7378acdc0-kube-api-access-k9929\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-s7n69\" (UID: \"eb75a895-10f2-4a54-a647-8bf7378acdc0\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.621031 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.620953 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:40.759310 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:40.759287 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69"] Jul 01 16:21:40.761354 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:21:40.761327 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb75a895_10f2_4a54_a647_8bf7378acdc0.slice/crio-45f237e289c3b3e9bd35520cf21f5123a0428be46174f80095fe2c7de72e5923 WatchSource:0}: Error finding container 45f237e289c3b3e9bd35520cf21f5123a0428be46174f80095fe2c7de72e5923: Status 404 returned error can't find the container with id 45f237e289c3b3e9bd35520cf21f5123a0428be46174f80095fe2c7de72e5923 Jul 01 16:21:41.196379 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:41.196341 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" event={"ID":"eb75a895-10f2-4a54-a647-8bf7378acdc0","Type":"ContainerStarted","Data":"45f237e289c3b3e9bd35520cf21f5123a0428be46174f80095fe2c7de72e5923"} Jul 01 16:21:42.203248 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:42.203168 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" event={"ID":"eb75a895-10f2-4a54-a647-8bf7378acdc0","Type":"ContainerStarted","Data":"c004af6dff630e249964ddd0e10011accceb5460ed692e2c366adb45395b1305"} Jul 01 16:21:42.233021 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:42.232963 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" podStartSLOduration=1.110527238 podStartE2EDuration="2.232944604s" totalImagesPullingTime="1.122417366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:21:42.229658249 +0000 UTC m=+792.429159929" watchObservedRunningTime="2026-07-01 16:21:42.232944604 +0000 UTC m=+792.432446285" Jul 01 16:21:50.621098 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:50.621060 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:50.621527 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:50.621127 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:50.633361 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:50.633338 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:21:51.262252 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:21:51.262225 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-s7n69" Jul 01 16:23:24.762257 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:24.762220 2583 generic.go:356] "Generic (PLEG): container finished" podID="8750e0f4-3561-44a8-82f2-7dd468279239" containerID="62e1bacd4b5ef84a6f290377771b3760aec04223e448ab2430f999e9ff37c3e7" exitCode=2 Jul 01 16:23:24.762653 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:24.762291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerDied","Data":"62e1bacd4b5ef84a6f290377771b3760aec04223e448ab2430f999e9ff37c3e7"} Jul 01 16:23:24.762653 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:24.762615 2583 scope.go:117] "RemoveContainer" containerID="62e1bacd4b5ef84a6f290377771b3760aec04223e448ab2430f999e9ff37c3e7" Jul 01 16:23:25.769329 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:25.769294 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerStarted","Data":"b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912"} Jul 01 16:23:25.769694 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:25.769516 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:23:30.191504 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:30.191475 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:23:30.192326 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:30.192305 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:23:30.204010 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:30.203988 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:23:30.204305 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:30.204286 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxqk5_d6a5676b-37b9-4dc2-aedd-f88738e7d645/ovn-acl-logging/0.log" Jul 01 16:23:36.776654 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:36.776621 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:23:56.938121 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:56.938090 2583 generic.go:356] "Generic (PLEG): container finished" podID="8750e0f4-3561-44a8-82f2-7dd468279239" containerID="b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912" exitCode=2 Jul 01 16:23:56.938496 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:56.938169 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerDied","Data":"b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912"} Jul 01 16:23:56.938496 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:56.938233 2583 scope.go:117] "RemoveContainer" containerID="62e1bacd4b5ef84a6f290377771b3760aec04223e448ab2430f999e9ff37c3e7" Jul 01 16:23:56.938604 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:56.938525 2583 scope.go:117] "RemoveContainer" containerID="b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912" Jul 01 16:23:56.938732 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:23:56.938709 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-mtmgw_openshift-ingress(8750e0f4-3561-44a8-82f2-7dd468279239)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" podUID="8750e0f4-3561-44a8-82f2-7dd468279239" Jul 01 16:23:59.818062 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:59.818031 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:23:59.818441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:23:59.818335 2583 scope.go:117] "RemoveContainer" containerID="b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912" Jul 01 16:23:59.818513 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:23:59.818492 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-mtmgw_openshift-ingress(8750e0f4-3561-44a8-82f2-7dd468279239)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" podUID="8750e0f4-3561-44a8-82f2-7dd468279239" Jul 01 16:24:02.414444 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:02.414415 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5968f65d96-zxwhp_fee31f6f-10c3-4772-bc3a-0a862fcf2e4d/nginx/0.log" Jul 01 16:24:02.766498 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:02.766473 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64d8659ff-6488v_a2792a82-6d10-42cd-8677-c724af5438f8/manager/0.log" Jul 01 16:24:03.114116 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:03.114062 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-26kz9_83c310cd-3a2d-404a-80e2-6a5470e61bc2/copy-manifests/0.log" Jul 01 16:24:03.122689 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:03.122668 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-26kz9_83c310cd-3a2d-404a-80e2-6a5470e61bc2/manager/0.log" Jul 01 16:24:04.135508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.135484 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/util/0.log" Jul 01 16:24:04.142954 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.142928 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/pull/0.log" Jul 01 16:24:04.150221 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.150198 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/extract/0.log" Jul 01 16:24:04.252801 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.252775 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/util/0.log" Jul 01 16:24:04.260702 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.260679 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/pull/0.log" Jul 01 16:24:04.267211 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.267189 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/extract/0.log" Jul 01 16:24:04.380560 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.380540 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/util/0.log" Jul 01 16:24:04.401245 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.401194 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/pull/0.log" Jul 01 16:24:04.409344 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.409325 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/extract/0.log" Jul 01 16:24:04.524746 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.524721 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/util/0.log" Jul 01 16:24:04.539609 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.539589 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/pull/0.log" Jul 01 16:24:04.552276 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:04.552253 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/extract/0.log" Jul 01 16:24:05.501312 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:05.501283 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w5q9n_01d921bf-671c-4085-bfb0-4658ab8693c9/manager/0.log" Jul 01 16:24:05.958443 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:05.958354 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bbtq8_90c3d217-1272-4679-a0eb-f734d660e6a3/discovery/0.log" Jul 01 16:24:06.391081 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:06.391055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cdmr9_575044e4-adb1-4e3a-8ac7-15a349bc4870/payload-pre-processing/0.log" Jul 01 16:24:06.501342 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:06.501301 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/1.log" Jul 01 16:24:06.774714 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:06.774688 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:24:06.775069 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:06.775054 2583 scope.go:117] "RemoveContainer" containerID="b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912" Jul 01 16:24:06.775236 ip-10-0-140-101 kubenswrapper[2583]: E0701 16:24:06.775217 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-mtmgw_openshift-ingress(8750e0f4-3561-44a8-82f2-7dd468279239)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" podUID="8750e0f4-3561-44a8-82f2-7dd468279239" Jul 01 16:24:06.949733 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:06.949711 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-s7n69_eb75a895-10f2-4a54-a647-8bf7378acdc0/main/0.log" Jul 01 16:24:11.975194 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.975165 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wddzr/must-gather-zjbk8"] Jul 01 16:24:11.978789 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.978770 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:11.981973 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.981957 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wddzr\"/\"default-dockercfg-x8ctx\"" Jul 01 16:24:11.982385 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.982367 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"openshift-service-ca.crt\"" Jul 01 16:24:11.983107 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.983093 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"kube-root-ca.crt\"" Jul 01 16:24:11.992687 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:11.992667 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/must-gather-zjbk8"] Jul 01 16:24:12.128894 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.128867 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a5011947-c638-4daf-8a70-8ae474002051-must-gather-output\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.129028 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.128918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swxpt\" (UniqueName: \"kubernetes.io/projected/a5011947-c638-4daf-8a70-8ae474002051-kube-api-access-swxpt\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.229508 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.229447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swxpt\" (UniqueName: \"kubernetes.io/projected/a5011947-c638-4daf-8a70-8ae474002051-kube-api-access-swxpt\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.229630 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.229513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a5011947-c638-4daf-8a70-8ae474002051-must-gather-output\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.229771 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.229754 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a5011947-c638-4daf-8a70-8ae474002051-must-gather-output\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.248862 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.248811 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swxpt\" (UniqueName: \"kubernetes.io/projected/a5011947-c638-4daf-8a70-8ae474002051-kube-api-access-swxpt\") pod \"must-gather-zjbk8\" (UID: \"a5011947-c638-4daf-8a70-8ae474002051\") " pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.287899 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.287853 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/must-gather-zjbk8" Jul 01 16:24:12.420275 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.420218 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/must-gather-zjbk8"] Jul 01 16:24:12.422643 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:24:12.422607 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5011947_c638_4daf_8a70_8ae474002051.slice/crio-0437be7899d81f593ea0cb36b1d68b7cf7b442cd0b321735746e299200ea68ab WatchSource:0}: Error finding container 0437be7899d81f593ea0cb36b1d68b7cf7b442cd0b321735746e299200ea68ab: Status 404 returned error can't find the container with id 0437be7899d81f593ea0cb36b1d68b7cf7b442cd0b321735746e299200ea68ab Jul 01 16:24:12.424537 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:12.424518 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:24:13.035749 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:13.035711 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/must-gather-zjbk8" event={"ID":"a5011947-c638-4daf-8a70-8ae474002051","Type":"ContainerStarted","Data":"0437be7899d81f593ea0cb36b1d68b7cf7b442cd0b321735746e299200ea68ab"} Jul 01 16:24:14.044895 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:14.044860 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/must-gather-zjbk8" event={"ID":"a5011947-c638-4daf-8a70-8ae474002051","Type":"ContainerStarted","Data":"8044b85009af9ceecfb155c96e926c9ca6f5cb5846a7b752679762467e83c884"} Jul 01 16:24:14.045284 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:14.044907 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/must-gather-zjbk8" event={"ID":"a5011947-c638-4daf-8a70-8ae474002051","Type":"ContainerStarted","Data":"ac5e7e0cea59d86b16b76ff3fc80c4a0740ed1dc72f9710786ba57c14301018e"} Jul 01 16:24:14.064486 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:14.064430 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wddzr/must-gather-zjbk8" podStartSLOduration=2.287583495 podStartE2EDuration="3.064415582s" totalImagesPullingTime="776.832087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:24:14.063239691 +0000 UTC m=+944.262741384" watchObservedRunningTime="2026-07-01 16:24:14.064415582 +0000 UTC m=+944.263917263" Jul 01 16:24:14.954315 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:14.954281 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfdhs_8dad4524-90ec-4f37-99ea-d45a476cb682/global-pull-secret-syncer/0.log" Jul 01 16:24:15.113626 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:15.113592 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wsppj_4f69fb28-7990-4b7b-b397-ef34ae18cef1/konnectivity-agent/0.log" Jul 01 16:24:15.200447 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:15.200415 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-101.ec2.internal_f1eb05d8c188be55ea323d7190a91915/haproxy/0.log" Jul 01 16:24:19.161731 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.161698 2583 scope.go:117] "RemoveContainer" containerID="b5ed211862513340e47c12cd79382d7cbf35003970910aa964e2ada01eb97912" Jul 01 16:24:19.555233 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.555200 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/extract/0.log" Jul 01 16:24:19.586553 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.586525 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/util/0.log" Jul 01 16:24:19.613232 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.613197 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595hfwc_b3dd2c90-3b93-4bef-bf18-e690053ae027/pull/0.log" Jul 01 16:24:19.644820 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.644789 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/extract/0.log" Jul 01 16:24:19.682649 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.682614 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/util/0.log" Jul 01 16:24:19.711118 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.711085 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wr4rp_6b185051-83d9-4384-9d58-7190984a78d1/pull/0.log" Jul 01 16:24:19.763255 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.763223 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/extract/0.log" Jul 01 16:24:19.787712 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.787681 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/util/0.log" Jul 01 16:24:19.820219 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.820138 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mnk9m_61cbc43b-95fa-4198-8751-1b560867295e/pull/0.log" Jul 01 16:24:19.857248 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.857207 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/extract/0.log" Jul 01 16:24:19.885049 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.885014 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/util/0.log" Jul 01 16:24:19.910915 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:19.910878 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ksg2_9b21e8e5-d268-43dc-888c-aaeaf9d31f98/pull/0.log" Jul 01 16:24:20.099945 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:20.099808 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" event={"ID":"8750e0f4-3561-44a8-82f2-7dd468279239","Type":"ContainerStarted","Data":"b69cfac34ad59715f73d607eb723ab655770c79b93629d13391bb602282a9ae4"} Jul 01 16:24:20.100144 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:20.100126 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:24:20.223857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:20.223814 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w5q9n_01d921bf-671c-4085-bfb0-4658ab8693c9/manager/0.log" Jul 01 16:24:22.130692 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.130662 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-tsm5p_f39d12dc-383b-4510-b00a-96b81ad13b9d/cluster-monitoring-operator/0.log" Jul 01 16:24:22.177622 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.177564 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-state-metrics/0.log" Jul 01 16:24:22.218044 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.217962 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-rbac-proxy-main/0.log" Jul 01 16:24:22.253602 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.253568 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-psdf9_f36c7a13-cf76-4380-a5c9-73f66033c0d9/kube-rbac-proxy-self/0.log" Jul 01 16:24:22.337230 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.337201 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-794x5_3b62b9bf-9a10-46f3-98b3-6cf7e659d3a2/monitoring-plugin/0.log" Jul 01 16:24:22.485481 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.485441 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/node-exporter/0.log" Jul 01 16:24:22.516865 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.516809 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/kube-rbac-proxy/0.log" Jul 01 16:24:22.550270 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.550233 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fj7_a7b54be9-6ffd-4755-a40e-e955f6815836/init-textfile/0.log" Jul 01 16:24:22.721536 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.721511 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/kube-rbac-proxy-main/0.log" Jul 01 16:24:22.758102 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.758019 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/kube-rbac-proxy-self/0.log" Jul 01 16:24:22.788217 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:22.788160 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kbxdk_04502e7b-fc30-4895-b086-2b9cb813cd35/openshift-state-metrics/0.log" Jul 01 16:24:23.140783 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.140703 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-klzfc_c77f816a-5ecb-46a5-81ed-837b67d7dbf3/prometheus-operator-admission-webhook/0.log" Jul 01 16:24:23.174805 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.174774 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d64b6cdb-kl2m4_4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8/telemeter-client/0.log" Jul 01 16:24:23.202709 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.202677 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d64b6cdb-kl2m4_4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8/reload/0.log" Jul 01 16:24:23.231175 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.231141 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79d64b6cdb-kl2m4_4e4dd30a-bc8c-4296-aeb8-b37d1a52cba8/kube-rbac-proxy/0.log" Jul 01 16:24:23.279445 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.279410 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/thanos-query/0.log" Jul 01 16:24:23.304822 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.304786 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-web/0.log" Jul 01 16:24:23.332351 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.332321 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy/0.log" Jul 01 16:24:23.360452 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.360423 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/prom-label-proxy/0.log" Jul 01 16:24:23.390484 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.390451 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-rules/0.log" Jul 01 16:24:23.418619 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:23.418542 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb4967f8-fxx7z_00a4135b-07f7-4ccd-815e-b7b3df0d7c26/kube-rbac-proxy-metrics/0.log" Jul 01 16:24:25.260749 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:25.260714 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/2.log" Jul 01 16:24:25.269146 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:25.269114 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-zc2vd_11353c03-1887-4f6d-b25e-a4d81008696b/console-operator/3.log" Jul 01 16:24:25.826935 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:25.826904 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5875f67f46-ltzb2_ad1abd5f-1a42-4d1d-b86d-8a4a0d5ed9a1/console/0.log" Jul 01 16:24:25.881313 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:25.881273 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-c5fch_22229dc1-cdac-4088-9de5-f2cc88efaea9/download-server/0.log" Jul 01 16:24:26.078678 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.078590 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w"] Jul 01 16:24:26.088718 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.088690 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.100552 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.100524 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w"] Jul 01 16:24:26.272808 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.272761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d48\" (UniqueName: \"kubernetes.io/projected/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-kube-api-access-x8d48\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.273305 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.272811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-lib-modules\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.273305 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.272888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-proc\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.273305 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.272922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-podres\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.273305 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.272940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-sys\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.373993 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.373896 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d48\" (UniqueName: \"kubernetes.io/projected/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-kube-api-access-x8d48\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.373993 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.373958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-lib-modules\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.373993 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.373994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-proc\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374025 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-podres\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-sys\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374098 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-proc\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374122 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-sys\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374175 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-podres\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.374287 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.374173 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-lib-modules\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.384221 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.384197 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d48\" (UniqueName: \"kubernetes.io/projected/16e161ef-bbd4-4bc8-b679-5daf378b2fe0-kube-api-access-x8d48\") pod \"perf-node-gather-daemonset-gt88w\" (UID: \"16e161ef-bbd4-4bc8-b679-5daf378b2fe0\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.400162 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.400135 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:26.579425 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:26.579401 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w"] Jul 01 16:24:26.582696 ip-10-0-140-101 kubenswrapper[2583]: W0701 16:24:26.582660 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16e161ef_bbd4_4bc8_b679_5daf378b2fe0.slice/crio-c6081080cf585a03bfd1694269ca00e89f6b10f59bc63be9612acf5c765b9e0a WatchSource:0}: Error finding container c6081080cf585a03bfd1694269ca00e89f6b10f59bc63be9612acf5c765b9e0a: Status 404 returned error can't find the container with id c6081080cf585a03bfd1694269ca00e89f6b10f59bc63be9612acf5c765b9e0a Jul 01 16:24:27.165762 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.165728 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" event={"ID":"16e161ef-bbd4-4bc8-b679-5daf378b2fe0","Type":"ContainerStarted","Data":"d0d7c4877ad3622eedd2249d9dcdb835ed4386d6d95af91fad41ce1461ce0990"} Jul 01 16:24:27.165977 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.165779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" event={"ID":"16e161ef-bbd4-4bc8-b679-5daf378b2fe0","Type":"ContainerStarted","Data":"c6081080cf585a03bfd1694269ca00e89f6b10f59bc63be9612acf5c765b9e0a"} Jul 01 16:24:27.165977 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.165826 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:27.186861 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.186791 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" podStartSLOduration=1.186769483 podStartE2EDuration="1.186769483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:24:27.184947676 +0000 UTC m=+957.384449363" watchObservedRunningTime="2026-07-01 16:24:27.186769483 +0000 UTC m=+957.386271161" Jul 01 16:24:27.802483 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.802443 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjstk_2e0c2c09-827b-43c7-b72f-b7dcbacb2597/dns/0.log" Jul 01 16:24:27.828091 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.828043 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjstk_2e0c2c09-827b-43c7-b72f-b7dcbacb2597/kube-rbac-proxy/0.log" Jul 01 16:24:27.861585 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:27.861552 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lp54_24162509-d5ad-4c93-884a-b2be4b44c6ef/dns-node-resolver/0.log" Jul 01 16:24:28.632589 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:28.632558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-snb6k_63b5239a-337a-4117-9c86-1cc825a23789/node-ca/0.log" Jul 01 16:24:29.745441 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:29.745405 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bbtq8_90c3d217-1272-4679-a0eb-f734d660e6a3/discovery/0.log" Jul 01 16:24:29.857405 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:29.857369 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cdmr9_575044e4-adb1-4e3a-8ac7-15a349bc4870/payload-pre-processing/0.log" Jul 01 16:24:29.890063 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:29.890033 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/2.log" Jul 01 16:24:29.891408 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:29.891381 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/1.log" Jul 01 16:24:30.642833 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:30.642789 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f7p8z_0b151564-a85d-4fa0-a038-a5baedad6fd0/serve-healthcheck-canary/0.log" Jul 01 16:24:31.112203 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:31.112173 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mtmgw" Jul 01 16:24:31.302579 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:31.302548 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sxwx_e086c724-48fe-493d-b5db-98c9cf270913/kube-rbac-proxy/0.log" Jul 01 16:24:31.328380 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:31.328348 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sxwx_e086c724-48fe-493d-b5db-98c9cf270913/exporter/0.log" Jul 01 16:24:31.351877 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:31.351825 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sxwx_e086c724-48fe-493d-b5db-98c9cf270913/extractor/0.log" Jul 01 16:24:33.184953 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:33.184919 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-gt88w" Jul 01 16:24:33.777805 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:33.777756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5968f65d96-zxwhp_fee31f6f-10c3-4772-bc3a-0a862fcf2e4d/nginx/0.log" Jul 01 16:24:33.881307 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:33.881279 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64d8659ff-6488v_a2792a82-6d10-42cd-8677-c724af5438f8/manager/0.log" Jul 01 16:24:33.983303 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:33.983267 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-26kz9_83c310cd-3a2d-404a-80e2-6a5470e61bc2/manager/0.log" Jul 01 16:24:34.005559 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:34.005536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-26kz9_83c310cd-3a2d-404a-80e2-6a5470e61bc2/copy-manifests/0.log" Jul 01 16:24:35.065672 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:35.065636 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bbtq8_90c3d217-1272-4679-a0eb-f734d660e6a3/discovery/0.log" Jul 01 16:24:35.141812 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:35.141760 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cdmr9_575044e4-adb1-4e3a-8ac7-15a349bc4870/payload-pre-processing/0.log" Jul 01 16:24:35.161190 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:35.161152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/2.log" Jul 01 16:24:35.161857 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:35.161815 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/1.log" Jul 01 16:24:35.749707 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:35.749682 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bb744ddb-dczq4_d6504a12-7b78-4e6d-93c1-e45b1b4c2c5e/manager/0.log" Jul 01 16:24:36.493655 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:36.493618 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bbtq8_90c3d217-1272-4679-a0eb-f734d660e6a3/discovery/0.log" Jul 01 16:24:36.572023 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:36.571990 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-cdmr9_575044e4-adb1-4e3a-8ac7-15a349bc4870/payload-pre-processing/0.log" Jul 01 16:24:36.594930 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:36.594899 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/2.log" Jul 01 16:24:36.596026 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:36.596006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mtmgw_8750e0f4-3561-44a8-82f2-7dd468279239/payload-processing/1.log" Jul 01 16:24:41.614613 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:41.614572 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2hqh2_6e5f02da-b908-477b-90fd-6c5d6b16452d/kube-storage-version-migrator-operator/1.log" Jul 01 16:24:41.616712 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:41.616682 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2hqh2_6e5f02da-b908-477b-90fd-6c5d6b16452d/kube-storage-version-migrator-operator/0.log" Jul 01 16:24:42.996929 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:42.996899 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/kube-multus-additional-cni-plugins/0.log" Jul 01 16:24:43.029578 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.029467 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/egress-router-binary-copy/0.log" Jul 01 16:24:43.056674 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.056641 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/cni-plugins/0.log" Jul 01 16:24:43.084223 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.084192 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/bond-cni-plugin/0.log" Jul 01 16:24:43.108514 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.108484 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/routeoverride-cni/0.log" Jul 01 16:24:43.140144 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.140111 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/whereabouts-cni-bincopy/0.log" Jul 01 16:24:43.171730 ip-10-0-140-101 kubenswrapper[2583]: I0701 16:24:43.171699 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phgpw_a33db57f-5763-4cff-9728-5dd46e918c7a/whereabouts-cni/0.log"