Jul 09 14:55:33.245844 ip-10-0-133-241 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:55:33.751972 ip-10-0-133-241 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:33.751972 ip-10-0-133-241 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:55:33.751972 ip-10-0-133-241 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:33.751972 ip-10-0-133-241 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:55:33.751972 ip-10-0-133-241 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:33.753163 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.753067 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:55:33.757154 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757133 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.757154 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757152 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.757154 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757156 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.757154 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757160 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757165 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757169 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757171 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757174 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757177 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757180 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757185 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757189 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757193 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757196 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757199 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757202 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757205 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757208 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757211 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757214 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757221 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757224 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.757295 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757227 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757230 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757233 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757236 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757238 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757241 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757244 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757247 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757249 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757252 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757254 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757257 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757260 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757263 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757266 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757269 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757272 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757275 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757278 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.757836 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757281 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757284 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757287 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757290 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757294 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757297 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757300 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757303 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757306 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757309 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757312 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757315 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757318 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757321 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757324 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757326 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757329 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757332 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757334 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757337 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.758327 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757340 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757343 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757346 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757349 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757352 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757354 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757357 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757360 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757364 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757367 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757370 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757374 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757377 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757379 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757382 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757385 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757387 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757390 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757392 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757395 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.758864 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757400 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757403 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757406 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757409 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757412 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757416 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757419 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757422 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757425 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757427 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757431 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757436 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757439 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757442 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757445 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757448 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757450 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.757453 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758279 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758288 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.759398 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758293 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758298 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758301 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758305 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758308 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758310 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758313 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758316 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758319 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758322 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758325 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758327 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758330 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758333 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758336 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758339 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758342 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758345 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758347 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758350 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.759909 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758353 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758356 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758358 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758361 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758364 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758367 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758369 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758374 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758379 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758382 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758386 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758389 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758392 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758396 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758399 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758402 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758405 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758408 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758411 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758414 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.760637 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758416 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758419 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758422 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758424 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758427 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758430 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758433 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758436 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758438 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758441 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758444 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758447 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758451 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758454 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758457 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758460 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758479 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758482 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758485 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.761155 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758488 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758491 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758496 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758499 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758502 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758506 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758510 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758513 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758515 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758519 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758522 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758525 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758530 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758534 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758537 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758540 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758543 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758546 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758548 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.761663 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758551 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758554 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758556 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758559 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758562 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758564 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758568 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758571 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758573 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758576 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758579 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758582 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758585 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758587 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758591 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758594 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758596 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758599 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.758602 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759032 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.762163 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759038 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759041 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759110 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759116 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759120 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759123 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759126 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759130 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759134 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759138 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759142 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759146 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759149 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759152 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759154 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759157 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759160 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759162 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759165 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.762692 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759168 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759171 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759175 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759178 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759181 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759184 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759186 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759189 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759191 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759194 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759197 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759199 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759202 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759205 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759208 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759210 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759213 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759216 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759218 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759221 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.763170 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759224 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759228 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759233 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759236 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759238 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759241 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759244 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759246 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759249 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759252 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759254 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759257 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759263 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759266 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759268 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759271 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759274 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759277 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759281 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.763714 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759284 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759287 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759290 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759293 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759296 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759299 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759302 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759305 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759307 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759310 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759313 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759316 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759319 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759321 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759324 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759327 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759329 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759333 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759336 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759339 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.764210 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759341 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759344 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759347 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759349 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759352 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759357 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759359 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759362 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759365 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759368 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759370 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759373 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759376 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759379 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759381 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759384 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759387 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759390 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759392 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.759395 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.764742 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759502 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759514 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759521 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759526 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759532 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759536 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759541 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759546 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759550 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759555 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759559 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759562 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759566 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759570 2568 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759573 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759576 2568 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759580 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759585 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759591 2568 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759594 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759597 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759601 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759604 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759608 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:55:33.765268 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759612 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759615 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759619 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759622 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759626 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759629 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759632 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759635 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759640 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759644 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759647 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759650 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759653 2568 flags.go:64] FLAG: --enable-server="true" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759657 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759662 2568 flags.go:64] FLAG: --event-burst="100" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759665 2568 flags.go:64] FLAG: --event-qps="50" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759668 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759673 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759677 2568 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759681 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759684 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759688 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759692 2568 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759695 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759698 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:55:33.765899 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759703 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759706 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759709 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759713 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759716 2568 flags.go:64] FLAG: --feature-gates="" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759720 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759723 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759727 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759730 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759734 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759737 2568 flags.go:64] FLAG: --help="false" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759740 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-133-241.ec2.internal" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759744 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759747 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759750 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759753 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759757 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759760 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759763 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759766 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759769 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759773 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759776 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759779 2568 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:55:33.766596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759784 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759787 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759790 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759793 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759796 2568 flags.go:64] FLAG: --lock-file="" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759799 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759802 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759806 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759819 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759822 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759826 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759829 2568 flags.go:64] FLAG: --logging-format="text" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759832 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759836 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759839 2568 flags.go:64] FLAG: --manifest-url="" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759843 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759848 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759851 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759856 2568 flags.go:64] FLAG: --max-pods="110" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759859 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759862 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759866 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759869 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759872 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759875 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:55:33.767210 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759879 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759888 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759892 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759895 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759899 2568 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759903 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759910 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759915 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759919 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759923 2568 flags.go:64] FLAG: --port="10250" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759927 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759930 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a7fd034bac9bdb50" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759934 2568 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759937 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759940 2568 flags.go:64] FLAG: --register-node="true" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759943 2568 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759949 2568 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759952 2568 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759955 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759958 2568 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759962 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759965 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759969 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759972 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759975 2568 flags.go:64] FLAG: --runonce="false" Jul 09 14:55:33.767906 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759978 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759981 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759985 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759988 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759991 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759994 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.759997 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760001 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760004 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760007 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760010 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760013 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760017 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760021 2568 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760025 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760031 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760034 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760038 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760043 2568 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760046 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760049 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760052 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760055 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760062 2568 flags.go:64] FLAG: --v="2" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760066 2568 flags.go:64] FLAG: --version="false" Jul 09 14:55:33.768585 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760071 2568 flags.go:64] FLAG: --vmodule="" Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760075 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.760079 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760210 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760214 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760217 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760220 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760224 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760227 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760230 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760233 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760236 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760239 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760242 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760246 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760249 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760252 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760256 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760260 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.769239 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760263 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760267 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760272 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760275 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760278 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760281 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760285 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760288 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760291 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760293 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760296 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760300 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760303 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760306 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760309 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760311 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760315 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760317 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760320 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760323 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.769758 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760326 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760329 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760332 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760335 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760337 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760340 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760343 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760346 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760349 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760351 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760354 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760357 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760359 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760362 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760366 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760370 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760376 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760379 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760382 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760385 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.770328 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760388 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760390 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760393 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760397 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760400 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760403 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760406 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760408 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760411 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760414 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760417 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760419 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760422 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760425 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760428 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760431 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760434 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760436 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760441 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.770879 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760444 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760447 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760450 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760453 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760455 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760458 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760476 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760481 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760484 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760488 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760490 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760493 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760496 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760499 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760502 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760504 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760509 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760512 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760516 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760520 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.771380 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760523 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760526 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760530 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.760533 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.761487 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.769331 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.769358 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.770119 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.770132 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770215 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770223 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770226 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770229 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770232 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770235 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.771964 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770238 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770241 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770245 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770248 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770253 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770257 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770261 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770264 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770267 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770270 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770273 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770277 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770280 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770283 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770286 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770289 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770292 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770295 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770299 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.772370 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770301 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770304 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770307 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770316 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770327 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770331 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770334 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770337 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770340 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770343 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770346 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770349 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770352 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770354 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770357 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770360 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770373 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770377 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770380 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.772874 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770383 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770385 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770388 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770391 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770394 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770397 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770399 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770402 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770405 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770408 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770410 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770413 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770416 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770419 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770422 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770425 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770428 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770431 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770440 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770443 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.773381 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770446 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770449 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770452 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770455 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770458 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770471 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770474 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770477 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770480 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770483 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770486 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770488 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770491 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770494 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770497 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770500 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770504 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770508 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770511 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.773936 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770514 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770517 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770520 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770522 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770525 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770528 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770530 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770533 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770536 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770539 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770544 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770556 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770559 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770561 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.774444 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770564 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.770570 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770751 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770756 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770760 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770763 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770766 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770769 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770772 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770776 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770779 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770782 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770785 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770787 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770790 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:33.775110 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770793 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770796 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770798 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770801 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770805 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770808 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770811 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770814 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770817 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770820 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770823 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770826 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770829 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770832 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770835 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770843 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770846 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770849 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770851 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770854 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:33.775804 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770857 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770860 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770862 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770865 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770868 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770870 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770873 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770875 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770878 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770881 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770884 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770887 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770890 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770894 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770898 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770901 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770904 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770907 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770911 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770913 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:33.776546 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770917 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770920 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770923 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770926 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770929 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770932 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770935 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770938 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770947 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770950 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770952 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770955 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770958 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770961 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770963 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770966 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770968 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770971 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770973 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770976 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:33.777088 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770979 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770982 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770986 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770990 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770992 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770995 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.770998 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771001 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771004 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771006 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771009 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771012 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771015 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771017 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771020 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771023 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771026 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771028 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771031 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:33.777619 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771034 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771037 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771045 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771048 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771051 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771054 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:33.771056 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.771062 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.771247 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.775746 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.777640 2568 server.go:1019] "Starting client certificate rotation" Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.777760 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:55:33.778112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.777806 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:55:33.780286 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.780269 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:55:33.781670 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.781643 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:55:33.793581 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.793548 2568 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:55:33.796104 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.796080 2568 log.go:25] "Validated CRI v1 image API" Jul 09 14:55:33.797106 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.797084 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:55:33.801102 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.801068 2568 fs.go:135] Filesystem UUIDs: map[50b702e2-b390-4496-803c-35215e4d1d4d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e8a3de88-a7a7-44f4-98ad-367dfdb132c3:/dev/nvme0n1p3] Jul 09 14:55:33.801165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.801101 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:55:33.807566 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.807409 2568 manager.go:216] Machine: {Timestamp:2026-07-09 14:55:33.806835725 +0000 UTC m=+0.421419577 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098411 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c0a12d5ff4d230ec2110f2d6cc098 SystemUUID:ec2c0a12-d5ff-4d23-0ec2-110f2d6cc098 BootID:c8a37be0-e874-483a-a7dd-ef70b30d6b29 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0c:de:82:7a:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0c:de:82:7a:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:2e:b8:26:89:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:55:33.807566 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.807557 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:55:33.807711 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.807664 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:55:33.810433 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.810393 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:55:33.811584 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.811550 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:55:33.811780 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.811594 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:55:33.813012 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.812996 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:55:33.813098 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.813017 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:55:33.813098 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.813036 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:55:33.814100 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.814083 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:55:33.815505 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.815488 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:55:33.818888 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.818866 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:55:33.819062 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819049 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:55:33.819121 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819097 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:55:33.819195 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819151 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:55:33.819195 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819177 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:55:33.819282 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819196 2568 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:55:33.819282 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.819213 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:55:33.820093 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.820074 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:55:33.820191 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.820104 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:55:33.824888 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.824868 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:55:33.826911 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.826886 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:55:33.826980 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.826925 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:55:33.827140 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827128 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:55:33.827174 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827148 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:55:33.827174 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827156 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:55:33.827174 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827162 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:55:33.827174 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827170 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:55:33.827284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827177 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:55:33.827923 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827913 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:55:33.827923 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827924 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:55:33.827989 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827931 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:55:33.827989 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827937 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:55:33.827989 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827946 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:55:33.827989 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.827954 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:55:33.829722 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.829709 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:55:33.829764 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.829724 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:55:33.833436 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.833394 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:55:33.833818 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.833785 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:55:33.833818 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.833809 2568 server.go:1268] "Started kubelet" Jul 09 14:55:33.833818 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.833787 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:55:33.834008 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.833868 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:55:33.834008 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.833964 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:55:33.834078 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.834042 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:55:33.835498 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.835476 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:55:33.835915 ip-10-0-133-241 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:55:33.838034 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.838016 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:55:33.841896 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.840211 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-241.ec2.internal.18c0a6e017601fb3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-241.ec2.internal,UID:ip-10-0-133-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-241.ec2.internal,},FirstTimestamp:2026-07-09 14:55:33.833777075 +0000 UTC m=+0.448360925,LastTimestamp:2026-07-09 14:55:33.833777075 +0000 UTC m=+0.448360925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-241.ec2.internal,}" Jul 09 14:55:33.842740 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.842722 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:55:33.842833 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.842812 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:55:33.842890 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.842867 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:33.842939 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.842881 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:55:33.843596 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.843468 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:55:33.843701 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.843607 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:55:33.843701 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.843624 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:55:33.843816 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.843760 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:55:33.843816 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.843773 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:55:33.844059 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844044 2568 factory.go:55] Registering systemd factory Jul 09 14:55:33.844059 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844061 2568 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:55:33.844439 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844419 2568 factory.go:153] Registering CRI-O factory Jul 09 14:55:33.844439 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844440 2568 factory.go:223] Registration of the crio container factory successfully Jul 09 14:55:33.844609 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844513 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:55:33.844609 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844537 2568 factory.go:103] Registering Raw factory Jul 09 14:55:33.844609 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844554 2568 manager.go:1196] Started watching for new ooms in manager Jul 09 14:55:33.844989 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.844976 2568 manager.go:349] Starting recovery of all containers Jul 09 14:55:33.845133 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.845104 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zllgk" Jul 09 14:55:33.858500 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.856227 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:55:33.858500 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.856436 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:55:33.858500 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.856908 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zllgk" Jul 09 14:55:33.858500 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.857104 2568 manager.go:354] Recovery completed Jul 09 14:55:33.864012 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.863995 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:33.866014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.865993 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:33.866133 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866023 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:33.866133 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866034 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:33.866665 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866645 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:55:33.866665 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866662 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:55:33.866665 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866666 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:33.866891 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.866679 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:55:33.867369 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867353 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:33.867415 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867383 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:33.867504 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867395 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:33.867764 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867752 2568 policy_none.go:49] "None policy: Start" Jul 09 14:55:33.867764 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867769 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:55:33.867879 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.867781 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:55:33.868697 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.868685 2568 policy_none.go:47] "Start" Jul 09 14:55:33.906265 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906241 2568 manager.go:337] "Starting Device Plugin manager" Jul 09 14:55:33.906499 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.906281 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:55:33.906499 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906291 2568 server.go:87] "Starting device plugin registration server" Jul 09 14:55:33.906675 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906661 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:55:33.906708 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906678 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:55:33.906802 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906781 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:55:33.907203 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906911 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:55:33.907203 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:33.906926 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:55:33.907542 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.907522 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:55:33.907605 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:33.907587 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.008711 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.008625 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:34.010970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.010001 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:34.010970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.010034 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:34.010970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.010047 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:34.010970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.010078 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.021466 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.021437 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.021567 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.021471 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-241.ec2.internal\": node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.045480 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.045434 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.089705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.089657 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:55:34.091122 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.091085 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:55:34.091245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.091132 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:55:34.091245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.091160 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:55:34.091245 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.091200 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:55:34.093955 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.093931 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:34.146632 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.146578 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.194430 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.194358 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal"] Jul 09 14:55:34.194543 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.194506 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:34.195545 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.195524 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:34.195672 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.195564 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:34.195672 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.195582 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:34.198080 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.198061 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:34.198261 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.198178 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.198261 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.198214 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:34.198988 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.198960 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:34.198988 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.198992 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:34.199144 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.199008 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:34.199144 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.199007 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:34.199144 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.199087 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:34.199144 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.199100 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:34.201476 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.201446 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.201566 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.201494 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:34.202288 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.202267 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:34.202366 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.202302 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:34.202366 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.202314 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:34.215106 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.215081 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-241.ec2.internal\" not found" node="ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.220019 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.219998 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-241.ec2.internal\" not found" node="ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.245265 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.245225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.245265 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.245266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.245521 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.245305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.247495 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.247460 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.345790 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345701 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.345790 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.345790 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.346005 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9589e3ff13c764f99fd24813eb6a730b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-241.ec2.internal\" (UID: \"9589e3ff13c764f99fd24813eb6a730b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.346005 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.346005 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.345820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47076b8004fedbd1f52e8d569b344586-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal\" (UID: \"47076b8004fedbd1f52e8d569b344586\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.348001 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.347979 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.448880 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.448845 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.522694 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.522650 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.523834 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.523814 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:34.549021 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.548976 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.649696 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.649591 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.750538 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.750490 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.777756 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.777730 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:55:34.778311 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.777915 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:55:34.850695 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.850662 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:34.861717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.861672 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:50:34 +0000 UTC" deadline="2028-03-06 13:32:28.65975204 +0000 UTC" Jul 09 14:55:34.861717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:34.861713 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14542h36m53.798043117s" Jul 09 14:55:34.951286 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:34.951172 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:35.047560 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.047525 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:35.051561 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.051532 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:35.152379 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.152335 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:35.231443 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:35.231379 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9589e3ff13c764f99fd24813eb6a730b.slice/crio-dfe73ece38ff99022d24230501b5d2c58b987c5ac69477a3f53b5183acb6dd5e WatchSource:0}: Error finding container dfe73ece38ff99022d24230501b5d2c58b987c5ac69477a3f53b5183acb6dd5e: Status 404 returned error can't find the container with id dfe73ece38ff99022d24230501b5d2c58b987c5ac69477a3f53b5183acb6dd5e Jul 09 14:55:35.235963 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.235944 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:55:35.253036 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.253000 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-241.ec2.internal\" not found" Jul 09 14:55:35.270395 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.270372 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:35.329232 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.329201 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:35.344014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.343974 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" Jul 09 14:55:35.357278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.357245 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:55:35.358465 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.358448 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" Jul 09 14:55:35.373074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.373054 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:55:35.427536 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:35.427493 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47076b8004fedbd1f52e8d569b344586.slice/crio-d608b0dc9cd050ed182297a6605bbdb9ac8f8e85b0e566cbf8ad6956e47b4937 WatchSource:0}: Error finding container d608b0dc9cd050ed182297a6605bbdb9ac8f8e85b0e566cbf8ad6956e47b4937: Status 404 returned error can't find the container with id d608b0dc9cd050ed182297a6605bbdb9ac8f8e85b0e566cbf8ad6956e47b4937 Jul 09 14:55:35.820641 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.820607 2568 apiserver.go:52] "Watching apiserver" Jul 09 14:55:35.830738 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.830684 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:55:35.831413 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.831127 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-9mlsj","kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm","openshift-cluster-node-tuning-operator/tuned-q62rf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal","openshift-network-diagnostics/network-check-target-jfrxt","openshift-network-operator/iptables-alerter-w2zs6","openshift-ovn-kubernetes/ovnkube-node-d25h7","kube-system/global-pull-secret-syncer-hfdgn","openshift-dns/node-resolver-j8ppp","openshift-image-registry/node-ca-mdcjs","openshift-multus/multus-2zl2k","openshift-multus/multus-additional-cni-plugins-jjmxk","openshift-multus/network-metrics-daemon-vdhd2"] Jul 09 14:55:35.834476 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.834388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.837136 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.836658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.837582 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.837551 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.837695 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.837634 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqxq7\"" Jul 09 14:55:35.837958 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.837790 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.837958 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.837899 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:55:35.839314 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.839292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.839686 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.839430 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:55:35.840096 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.839807 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.840096 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.839819 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.840261 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.840237 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7rdxb\"" Jul 09 14:55:35.841976 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.841789 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:55:35.841976 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.841972 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.842149 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.842042 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dj7kh\"" Jul 09 14:55:35.842299 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.842279 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.842387 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.842300 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.843005 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.842953 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:55:35.844669 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.844645 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:35.844758 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.844738 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:35.845399 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.845188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tnvqv\"" Jul 09 14:55:35.845399 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.845204 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.845399 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.845362 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.849681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.849656 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:35.849806 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.849774 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:35.852266 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.852238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:35.852378 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.852321 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:35.856192 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.855595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856566 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvwj\" (UniqueName: \"kubernetes.io/projected/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-kube-api-access-6xvwj\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-systemd\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-tuned\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-conf\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-sys-fs\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5879\" (UniqueName: \"kubernetes.io/projected/68465bae-380b-4227-9d42-a3031b4cb1ef-kube-api-access-c5879\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f97c5d2-8209-40c5-b489-a5bbedf4b624-host\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-sys\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-lib-modules\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-var-lib-kubelet\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856934 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-host\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-run\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.856978 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-tmp\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysconfig\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-device-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0402d59-5961-43d3-8720-d050b4bc7148-iptables-alerter-script\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jkct\" (UniqueName: \"kubernetes.io/projected/f0402d59-5961-43d3-8720-d050b4bc7148-kube-api-access-8jkct\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857111 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f97c5d2-8209-40c5-b489-a5bbedf4b624-serviceca\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz9b\" (UniqueName: \"kubernetes.io/projected/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-kube-api-access-ldz9b\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dgqc\" (UniqueName: \"kubernetes.io/projected/5f97c5d2-8209-40c5-b489-a5bbedf4b624-kube-api-access-6dgqc\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-socket-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857333 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-kubernetes\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0402d59-5961-43d3-8720-d050b4bc7148-host-slash\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-registration-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-modprobe-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.857951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.857543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:35.858611 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.858111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.858671 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.858640 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:55:35.858724 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.858710 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:55:35.858772 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.858755 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:55:35.859364 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.859189 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:55:35.859364 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.859238 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zmgzp\"" Jul 09 14:55:35.859548 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.859479 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.859790 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.859723 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.861564 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.861000 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.861835 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.861952 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.861978 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9rjhf\"" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.862040 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.862125 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.862193 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.862147 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:55:35.862748 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.862207 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.864549 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.864506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:35.865701 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.865677 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:55:35.866734 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.866711 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:55:35.867349 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.867330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:55:35.867501 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.867339 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-952l4\"" Jul 09 14:55:35.867982 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.867950 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pf65n\"" Jul 09 14:55:35.869561 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.869537 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:55:35.870504 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.870138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.872852 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.872716 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hd6sz\"" Jul 09 14:55:35.872852 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.872842 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:55:35.886689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.886658 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnr7j" Jul 09 14:55:35.898991 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.898649 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnr7j" Jul 09 14:55:35.945357 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.945274 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-run\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-system-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jkct\" (UniqueName: \"kubernetes.io/projected/f0402d59-5961-43d3-8720-d050b4bc7148-kube-api-access-8jkct\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz9b\" (UniqueName: \"kubernetes.io/projected/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-kube-api-access-ldz9b\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958777 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-config\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958727 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-run\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8l5g\" (UniqueName: \"kubernetes.io/projected/86327973-5c1a-4dc5-ad80-6284239e5969-kube-api-access-x8l5g\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-os-release\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-systemd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-kubelet-config\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958964 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-conf-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.958993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-modprobe-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvwj\" (UniqueName: \"kubernetes.io/projected/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-kube-api-access-6xvwj\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:35.959249 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovn-node-metrics-cert\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-socket-dir-parent\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-ovn\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-bin\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959181 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-modprobe-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-conf\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959181 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-sys-fs\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5879\" (UniqueName: \"kubernetes.io/projected/68465bae-380b-4227-9d42-a3031b4cb1ef-kube-api-access-c5879\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-sys-fs\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-conf\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-daemon-config\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f97c5d2-8209-40c5-b489-a5bbedf4b624-host\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-k8s-cni-cncf-io\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-lib-modules\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-var-lib-kubelet\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cnibin\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959697 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f97c5d2-8209-40c5-b489-a5bbedf4b624-host\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz8n6\" (UniqueName: \"kubernetes.io/projected/cfbda6d1-ca22-4467-8c97-a85fea9f6517-kube-api-access-wz8n6\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-netns\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-env-overrides\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959842 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-tmp\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysctl-d\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-dbus\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86327973-5c1a-4dc5-ad80-6284239e5969-hosts-file\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-multus\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-lib-modules\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.959981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysconfig\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-device-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960044 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-sysconfig\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.961245 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0402d59-5961-43d3-8720-d050b4bc7148-iptables-alerter-script\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960152 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f97c5d2-8209-40c5-b489-a5bbedf4b624-serviceca\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f97c5d2-8209-40c5-b489-a5bbedf4b624-serviceca\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960756 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0402d59-5961-43d3-8720-d050b4bc7148-iptables-alerter-script\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9659f084-c36c-4e99-87c9-ba6d4405e4bc-agent-certs\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-var-lib-kubelet\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-multus-certs\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960867 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960881 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-device-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dgqc\" (UniqueName: \"kubernetes.io/projected/5f97c5d2-8209-40c5-b489-a5bbedf4b624-kube-api-access-6dgqc\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-socket-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.960956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-kubernetes\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961071 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-socket-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961111 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-kubernetes\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-systemd-units\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-var-lib-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-node-log\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-log-socket\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0402d59-5961-43d3-8720-d050b4bc7148-host-slash\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-registration-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961376 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0402d59-5961-43d3-8720-d050b4bc7148-host-slash\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-system-cni-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-slash\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961446 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68465bae-380b-4227-9d42-a3031b4cb1ef-registration-dir\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-netd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.961492 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-script-lib\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7klrm\" (UniqueName: \"kubernetes.io/projected/90e57f2f-eeb1-491b-99c2-892c00809dc0-kube-api-access-7klrm\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.962944 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:35.961560 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:36.461538572 +0000 UTC m=+3.076122438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-systemd\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-tuned\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-bin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-etc-kubernetes\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-os-release\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-etc-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9659f084-c36c-4e99-87c9-ba6d4405e4bc-konnectivity-ca\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-netns\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-hostroot\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.961981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwnt\" (UniqueName: \"kubernetes.io/projected/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-kube-api-access-wdwnt\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-kubelet\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962031 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-systemd\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86327973-5c1a-4dc5-ad80-6284239e5969-tmp-dir\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:35.963752 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cnibin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-kubelet\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962232 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-sys\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-host\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cni-binary-copy\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962435 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-sys\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.964552 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.962483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-host\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.966215 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.965809 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-tmp\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.966215 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.965918 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-etc-tuned\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.970514 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.970413 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jkct\" (UniqueName: \"kubernetes.io/projected/f0402d59-5961-43d3-8720-d050b4bc7148-kube-api-access-8jkct\") pod \"iptables-alerter-w2zs6\" (UID: \"f0402d59-5961-43d3-8720-d050b4bc7148\") " pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:35.971828 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.971796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz9b\" (UniqueName: \"kubernetes.io/projected/0b6c98da-86c5-4db8-9d15-7ed2a0b96089-kube-api-access-ldz9b\") pod \"tuned-q62rf\" (UID: \"0b6c98da-86c5-4db8-9d15-7ed2a0b96089\") " pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:35.973386 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.972945 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5879\" (UniqueName: \"kubernetes.io/projected/68465bae-380b-4227-9d42-a3031b4cb1ef-kube-api-access-c5879\") pod \"aws-ebs-csi-driver-node-59vdm\" (UID: \"68465bae-380b-4227-9d42-a3031b4cb1ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:35.974403 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.974374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dgqc\" (UniqueName: \"kubernetes.io/projected/5f97c5d2-8209-40c5-b489-a5bbedf4b624-kube-api-access-6dgqc\") pod \"node-ca-mdcjs\" (UID: \"5f97c5d2-8209-40c5-b489-a5bbedf4b624\") " pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:35.977114 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:35.976896 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvwj\" (UniqueName: \"kubernetes.io/projected/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-kube-api-access-6xvwj\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:36.063065 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cnibin\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.063065 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz8n6\" (UniqueName: \"kubernetes.io/projected/cfbda6d1-ca22-4467-8c97-a85fea9f6517-kube-api-access-wz8n6\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cnibin\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-netns\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063256 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-netns\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-env-overrides\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.063338 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-dbus\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86327973-5c1a-4dc5-ad80-6284239e5969-hosts-file\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063504 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-multus\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063539 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9659f084-c36c-4e99-87c9-ba6d4405e4bc-agent-certs\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-multus-certs\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.063689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-systemd-units\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-var-lib-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-node-log\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-log-socket\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-system-cni-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-slash\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-netd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-script-lib\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7klrm\" (UniqueName: \"kubernetes.io/projected/90e57f2f-eeb1-491b-99c2-892c00809dc0-kube-api-access-7klrm\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.063967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-var-lib-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064044 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064074 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-bin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-slash\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-etc-kubernetes\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-os-release\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-multus-certs\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064227 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-node-log\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-log-socket\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064307 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-system-cni-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064119 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-script-lib\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.064705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064681 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-netd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064743 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86327973-5c1a-4dc5-ad80-6284239e5969-hosts-file\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-etc-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9659f084-c36c-4e99-87c9-ba6d4405e4bc-konnectivity-ca\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-netns\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.064882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-dbus\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.065264 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065133 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065348 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-env-overrides\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065403 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-multus\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065487 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfbda6d1-ca22-4467-8c97-a85fea9f6517-os-release\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-hostroot\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065588 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-hostroot\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065599 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-systemd-units\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-netns\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065656 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-cni-bin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065704 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-etc-kubernetes\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065761 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-etc-openvswitch\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwnt\" (UniqueName: \"kubernetes.io/projected/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-kube-api-access-wdwnt\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-kubelet\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86327973-5c1a-4dc5-ad80-6284239e5969-tmp-dir\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065881 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cnibin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-kubelet\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cni-binary-copy\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.065992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.065997 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-system-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-config\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066074 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8l5g\" (UniqueName: \"kubernetes.io/projected/86327973-5c1a-4dc5-ad80-6284239e5969-kube-api-access-x8l5g\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-os-release\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-systemd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-kubelet-config\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066171 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-conf-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9659f084-c36c-4e99-87c9-ba6d4405e4bc-konnectivity-ca\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovn-node-metrics-cert\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066220 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-socket-dir-parent\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-ovn\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066293 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-system-cni-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066308 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-bin\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-daemon-config\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066412 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-socket-dir-parent\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.066576 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-k8s-cni-cncf-io\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-cni-bin\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-var-lib-kubelet\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066583 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cnibin\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-kubelet\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-conf-dir\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.067414 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.066832 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:36.068964 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.067867 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86327973-5c1a-4dc5-ad80-6284239e5969-tmp-dir\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.067908 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-host-run-k8s-cni-cncf-io\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.067928 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-ovn\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.067963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ace0a276-2479-4e01-9a67-7361156c2c2b-kubelet-config\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.068350 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-cni-binary-copy\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.068416 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-os-release\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.068897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-multus-daemon-config\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.069101 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.068932 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovnkube-config\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.069503 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.069138 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-run-systemd\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.069503 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.069188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e57f2f-eeb1-491b-99c2-892c00809dc0-ovn-node-metrics-cert\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.069503 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.069307 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9659f084-c36c-4e99-87c9-ba6d4405e4bc-agent-certs\") pod \"konnectivity-agent-9mlsj\" (UID: \"9659f084-c36c-4e99-87c9-ba6d4405e4bc\") " pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:36.069503 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.066687 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90e57f2f-eeb1-491b-99c2-892c00809dc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.069714 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.069518 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:36.569480672 +0000 UTC m=+3.184064522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:36.069714 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.069574 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfbda6d1-ca22-4467-8c97-a85fea9f6517-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.070713 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.070637 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:36.070713 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.070671 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:36.070713 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.070686 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:36.070972 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.070762 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:55:36.570745414 +0000 UTC m=+3.185329254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:36.075125 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.075096 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz8n6\" (UniqueName: \"kubernetes.io/projected/cfbda6d1-ca22-4467-8c97-a85fea9f6517-kube-api-access-wz8n6\") pod \"multus-additional-cni-plugins-jjmxk\" (UID: \"cfbda6d1-ca22-4467-8c97-a85fea9f6517\") " pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.077074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.077023 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7klrm\" (UniqueName: \"kubernetes.io/projected/90e57f2f-eeb1-491b-99c2-892c00809dc0-kube-api-access-7klrm\") pod \"ovnkube-node-d25h7\" (UID: \"90e57f2f-eeb1-491b-99c2-892c00809dc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.077567 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.077522 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwnt\" (UniqueName: \"kubernetes.io/projected/67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2-kube-api-access-wdwnt\") pod \"multus-2zl2k\" (UID: \"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2\") " pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.086165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.086125 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8l5g\" (UniqueName: \"kubernetes.io/projected/86327973-5c1a-4dc5-ad80-6284239e5969-kube-api-access-x8l5g\") pod \"node-resolver-j8ppp\" (UID: \"86327973-5c1a-4dc5-ad80-6284239e5969\") " pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.098832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.098758 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerStarted","Data":"d608b0dc9cd050ed182297a6605bbdb9ac8f8e85b0e566cbf8ad6956e47b4937"} Jul 09 14:55:36.100613 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.100578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" event={"ID":"9589e3ff13c764f99fd24813eb6a730b","Type":"ContainerStarted","Data":"dfe73ece38ff99022d24230501b5d2c58b987c5ac69477a3f53b5183acb6dd5e"} Jul 09 14:55:36.148920 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.148883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w2zs6" Jul 09 14:55:36.160053 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.160011 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdcjs" Jul 09 14:55:36.164123 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.164075 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0402d59_5961_43d3_8720_d050b4bc7148.slice/crio-d2e2f6c2eb11830041b36e98150755b5af4106fc70d94316571df330733ccd12 WatchSource:0}: Error finding container d2e2f6c2eb11830041b36e98150755b5af4106fc70d94316571df330733ccd12: Status 404 returned error can't find the container with id d2e2f6c2eb11830041b36e98150755b5af4106fc70d94316571df330733ccd12 Jul 09 14:55:36.172780 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.172737 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f97c5d2_8209_40c5_b489_a5bbedf4b624.slice/crio-3daec9a71f27e220d292f422b2470cc3e85f0f7efa1826216d2c4bafece3586d WatchSource:0}: Error finding container 3daec9a71f27e220d292f422b2470cc3e85f0f7efa1826216d2c4bafece3586d: Status 404 returned error can't find the container with id 3daec9a71f27e220d292f422b2470cc3e85f0f7efa1826216d2c4bafece3586d Jul 09 14:55:36.173960 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.173933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" Jul 09 14:55:36.181553 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.181520 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q62rf" Jul 09 14:55:36.187893 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.187859 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68465bae_380b_4227_9d42_a3031b4cb1ef.slice/crio-103d44b358ebfa4d6dcd86738b5443dc524108feac9e0bb76480f778df7e5861 WatchSource:0}: Error finding container 103d44b358ebfa4d6dcd86738b5443dc524108feac9e0bb76480f778df7e5861: Status 404 returned error can't find the container with id 103d44b358ebfa4d6dcd86738b5443dc524108feac9e0bb76480f778df7e5861 Jul 09 14:55:36.189344 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.189110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" Jul 09 14:55:36.199290 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.199219 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:55:36.199643 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.199619 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:36.201146 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.201112 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6c98da_86c5_4db8_9d15_7ed2a0b96089.slice/crio-5a92fcaa0ee65f0a6b4f5de1ee0dc63eef882f83687585736ae2b184b6df9f62 WatchSource:0}: Error finding container 5a92fcaa0ee65f0a6b4f5de1ee0dc63eef882f83687585736ae2b184b6df9f62: Status 404 returned error can't find the container with id 5a92fcaa0ee65f0a6b4f5de1ee0dc63eef882f83687585736ae2b184b6df9f62 Jul 09 14:55:36.201700 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.201666 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbda6d1_ca22_4467_8c97_a85fea9f6517.slice/crio-d314d6c948a739f3237a0acd8cad3b08deb2e6ac663a6a01ca052ad90dcd5fa8 WatchSource:0}: Error finding container d314d6c948a739f3237a0acd8cad3b08deb2e6ac663a6a01ca052ad90dcd5fa8: Status 404 returned error can't find the container with id d314d6c948a739f3237a0acd8cad3b08deb2e6ac663a6a01ca052ad90dcd5fa8 Jul 09 14:55:36.206572 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.206342 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8ppp" Jul 09 14:55:36.212974 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.212932 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e57f2f_eeb1_491b_99c2_892c00809dc0.slice/crio-4afe42b54284310c6fdd0ba5ea2e4a6994aff1aa1f5b11194c892ac0e422ab40 WatchSource:0}: Error finding container 4afe42b54284310c6fdd0ba5ea2e4a6994aff1aa1f5b11194c892ac0e422ab40: Status 404 returned error can't find the container with id 4afe42b54284310c6fdd0ba5ea2e4a6994aff1aa1f5b11194c892ac0e422ab40 Jul 09 14:55:36.216124 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.216070 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:36.219534 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:36.219348 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86327973_5c1a_4dc5_ad80_6284239e5969.slice/crio-e5512d7e9c9dac90215f7bf321ae98e508b1dc077e54e474baa274b1e2b9a064 WatchSource:0}: Error finding container e5512d7e9c9dac90215f7bf321ae98e508b1dc077e54e474baa274b1e2b9a064: Status 404 returned error can't find the container with id e5512d7e9c9dac90215f7bf321ae98e508b1dc077e54e474baa274b1e2b9a064 Jul 09 14:55:36.226846 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.226816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2zl2k" Jul 09 14:55:36.469932 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.469829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:36.470107 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.470050 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:36.470160 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.470144 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:37.470121026 +0000 UTC m=+4.084704879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:36.571307 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.571266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:36.571539 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.571366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:36.571539 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571509 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:36.571539 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571536 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:36.571705 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571548 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:36.571705 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571520 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:36.571705 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571616 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:55:37.571595381 +0000 UTC m=+4.186179268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:36.571705 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:36.571680 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:37.571653176 +0000 UTC m=+4.186237026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:36.902657 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.902551 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:36 +0000 UTC" deadline="2028-03-18 02:45:28.806235586 +0000 UTC" Jul 09 14:55:36.902657 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:36.902592 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14819h49m51.903648183s" Jul 09 14:55:37.092129 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.091555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:37.092129 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.091710 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:37.105495 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.105394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8ppp" event={"ID":"86327973-5c1a-4dc5-ad80-6284239e5969","Type":"ContainerStarted","Data":"e5512d7e9c9dac90215f7bf321ae98e508b1dc077e54e474baa274b1e2b9a064"} Jul 09 14:55:37.107192 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.107123 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerStarted","Data":"d314d6c948a739f3237a0acd8cad3b08deb2e6ac663a6a01ca052ad90dcd5fa8"} Jul 09 14:55:37.108627 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.108591 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q62rf" event={"ID":"0b6c98da-86c5-4db8-9d15-7ed2a0b96089","Type":"ContainerStarted","Data":"5a92fcaa0ee65f0a6b4f5de1ee0dc63eef882f83687585736ae2b184b6df9f62"} Jul 09 14:55:37.111075 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.111043 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" event={"ID":"68465bae-380b-4227-9d42-a3031b4cb1ef","Type":"ContainerStarted","Data":"103d44b358ebfa4d6dcd86738b5443dc524108feac9e0bb76480f778df7e5861"} Jul 09 14:55:37.112611 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.112580 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w2zs6" event={"ID":"f0402d59-5961-43d3-8720-d050b4bc7148","Type":"ContainerStarted","Data":"d2e2f6c2eb11830041b36e98150755b5af4106fc70d94316571df330733ccd12"} Jul 09 14:55:37.114659 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.114620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"4afe42b54284310c6fdd0ba5ea2e4a6994aff1aa1f5b11194c892ac0e422ab40"} Jul 09 14:55:37.117057 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.117023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdcjs" event={"ID":"5f97c5d2-8209-40c5-b489-a5bbedf4b624","Type":"ContainerStarted","Data":"3daec9a71f27e220d292f422b2470cc3e85f0f7efa1826216d2c4bafece3586d"} Jul 09 14:55:37.458190 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:37.458154 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9659f084_c36c_4e99_87c9_ba6d4405e4bc.slice/crio-55b26275e29ed7d46ac7a8248b35abb831c491ae320e16926f2e3935ad02c2d8 WatchSource:0}: Error finding container 55b26275e29ed7d46ac7a8248b35abb831c491ae320e16926f2e3935ad02c2d8: Status 404 returned error can't find the container with id 55b26275e29ed7d46ac7a8248b35abb831c491ae320e16926f2e3935ad02c2d8 Jul 09 14:55:37.463738 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:55:37.463701 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dc6bf3_f1a5_4881_b9b7_d0ecba8c13f2.slice/crio-b88a29a28c71e21def6fc16d8f3bba33974b6c4c1b86f009b82b0a22bd8048a0 WatchSource:0}: Error finding container b88a29a28c71e21def6fc16d8f3bba33974b6c4c1b86f009b82b0a22bd8048a0: Status 404 returned error can't find the container with id b88a29a28c71e21def6fc16d8f3bba33974b6c4c1b86f009b82b0a22bd8048a0 Jul 09 14:55:37.479335 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.479300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:37.479547 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.479499 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:37.479627 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.479605 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:39.479579975 +0000 UTC m=+6.094163816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.580079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.580430 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.580651 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.580729 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:39.580707769 +0000 UTC m=+6.195291623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.581246 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.581267 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.581282 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:37.581387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:37.581343 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:55:39.581321048 +0000 UTC m=+6.195904901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:37.903401 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.903214 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:36 +0000 UTC" deadline="2028-03-27 02:01:13.678794366 +0000 UTC" Jul 09 14:55:37.903401 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:37.903300 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15035h5m35.775499848s" Jul 09 14:55:38.093022 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.092421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:38.093022 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:38.092584 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:38.094720 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.094490 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:38.094720 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:38.094635 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:38.141149 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.141106 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" event={"ID":"9589e3ff13c764f99fd24813eb6a730b","Type":"ContainerStarted","Data":"b524f8cf5d53dbff9a8dd37bf33969ff6097064165b4ae8f14c11962141bbe7a"} Jul 09 14:55:38.155945 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.155904 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mlsj" event={"ID":"9659f084-c36c-4e99-87c9-ba6d4405e4bc","Type":"ContainerStarted","Data":"55b26275e29ed7d46ac7a8248b35abb831c491ae320e16926f2e3935ad02c2d8"} Jul 09 14:55:38.166010 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.163727 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-241.ec2.internal" podStartSLOduration=3.163701744 podStartE2EDuration="3.163701744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:38.162392563 +0000 UTC m=+4.776976426" watchObservedRunningTime="2026-07-09 14:55:38.163701744 +0000 UTC m=+4.778285608" Jul 09 14:55:38.166010 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:38.165736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2zl2k" event={"ID":"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2","Type":"ContainerStarted","Data":"b88a29a28c71e21def6fc16d8f3bba33974b6c4c1b86f009b82b0a22bd8048a0"} Jul 09 14:55:39.092706 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.092070 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:39.092706 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.092253 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:39.180666 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.180058 2568 generic.go:356] "Generic (PLEG): container finished" podID="47076b8004fedbd1f52e8d569b344586" containerID="43feaa9f729b81c506025e504605c7c4e7ff43f6412a5a2e192a8f87a8c9387d" exitCode=0 Jul 09 14:55:39.181085 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.180973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerDied","Data":"43feaa9f729b81c506025e504605c7c4e7ff43f6412a5a2e192a8f87a8c9387d"} Jul 09 14:55:39.500579 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.500480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:39.500777 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.500730 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:39.500848 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.500818 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.500796824 +0000 UTC m=+10.115380660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:39.601067 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.601023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:39.601253 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:39.601105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:39.601253 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601204 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:39.601387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601289 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.60126766 +0000 UTC m=+10.215851497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:39.601387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601302 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:39.601387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601324 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:39.601387 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601339 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:39.601650 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:39.601392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.601376104 +0000 UTC m=+10.215959946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:40.092435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:40.092393 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:40.092664 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:40.092593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:40.093173 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:40.093146 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:40.093628 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:40.093268 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:41.091845 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:41.091807 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:41.092044 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:41.091973 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:42.091955 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:42.091915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:42.092458 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:42.091915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:42.092458 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:42.092063 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:42.092458 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:42.092138 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:43.091982 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:43.091942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:43.092517 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.092096 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:43.538209 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:43.538067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:43.538375 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.538252 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:43.538375 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.538335 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:51.538312234 +0000 UTC m=+18.152896074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:43.639139 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:43.639098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:43.639341 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:43.639192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:43.639341 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639325 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:43.639524 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639361 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:43.639524 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639404 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:43.639524 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639424 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:43.639524 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639406 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:51.639370022 +0000 UTC m=+18.253953859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:43.639524 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:43.639488 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:55:51.639469693 +0000 UTC m=+18.254053529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:44.091979 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:44.091941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:44.092191 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:44.092105 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:44.093440 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:44.093265 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:44.093440 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:44.093371 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:45.091843 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:45.091805 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:45.092059 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:45.091970 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:46.091544 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:46.091498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:46.092050 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:46.091508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:46.092050 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:46.091632 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:46.092050 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:46.091717 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:47.092138 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:47.092104 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:47.092678 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:47.092260 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:48.091870 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:48.091818 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:48.092074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:48.091836 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:48.092074 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:48.091964 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:48.092183 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:48.092073 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:49.091801 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:49.091761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:49.092000 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:49.091904 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:50.092289 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:50.092244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:50.092819 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:50.092294 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:50.092819 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:50.092402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:50.092819 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:50.092478 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:51.091973 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:51.091939 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:51.092204 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.092075 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:51.604180 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:51.604140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:51.604631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.604336 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:51.604631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.604425 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:07.604405068 +0000 UTC m=+34.218988914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:51.704814 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:51.704778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:51.704814 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:51.704837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.704939 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.704974 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.704994 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:56:07.704980812 +0000 UTC m=+34.319564646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.704999 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.705013 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:51.705089 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:51.705070 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:56:07.705053655 +0000 UTC m=+34.319637509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:52.091748 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:52.091708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:52.091905 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:52.091849 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:52.091990 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:52.091899 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:52.092045 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:52.092025 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:53.091341 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:53.091308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:53.091795 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:53.091454 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:54.092784 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:54.092751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:54.093213 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:54.092865 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:54.093213 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:54.092921 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:54.093213 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:54.093036 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:55.091845 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:55.091811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:55.092030 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:55.091942 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:56.092323 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:56.092288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:56.092762 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:56.092418 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:56.092762 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:56.092430 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:56.092762 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:56.092540 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:57.092057 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.091716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:57.092364 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:57.092177 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:57.232104 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.232065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" event={"ID":"47076b8004fedbd1f52e8d569b344586","Type":"ContainerStarted","Data":"e87fa68e55dd88b0e38f3c258bcae3f6e351bcd553f470f7abc288da9c204272"} Jul 09 14:55:57.233620 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.233593 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8ppp" event={"ID":"86327973-5c1a-4dc5-ad80-6284239e5969","Type":"ContainerStarted","Data":"67c08a86364a8eeb8509bf29e8602a00beeba302a9f9fbb159e0206014caafaf"} Jul 09 14:55:57.235154 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.235127 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="16e0385fc1a4f9756ec4e91f0177df5fb750fdc636cc5e451077adac04470dab" exitCode=0 Jul 09 14:55:57.235286 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.235202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"16e0385fc1a4f9756ec4e91f0177df5fb750fdc636cc5e451077adac04470dab"} Jul 09 14:55:57.236820 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.236800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q62rf" event={"ID":"0b6c98da-86c5-4db8-9d15-7ed2a0b96089","Type":"ContainerStarted","Data":"31b50df0787eae109582f80c87c72fbf580c8b6de07afa5c58d70c09bf2897b8"} Jul 09 14:55:57.238317 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.238290 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" event={"ID":"68465bae-380b-4227-9d42-a3031b4cb1ef","Type":"ContainerStarted","Data":"fe3470b2ae91636c9d8e8c1ee2ed11cd684aa3bb0db7a7f50101afa7f6c7916a"} Jul 09 14:55:57.239870 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.239766 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mlsj" event={"ID":"9659f084-c36c-4e99-87c9-ba6d4405e4bc","Type":"ContainerStarted","Data":"deef3f6a973231316bcba53dabfe119a19e62c0a0ee0b2acfba8849b30d2c4a0"} Jul 09 14:55:57.242820 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242798 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"615834f3d4c0d3a508f27a999909a1b6d3d75fc13ddfbb769f06ffcb368ecdce"} Jul 09 14:55:57.242890 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242858 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"1c04c8cbad0c6fcc8a6714e36ede8bb03c080d0776d752042ed6ed1d0901dd36"} Jul 09 14:55:57.242933 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"bd357896f26d6fe09cf4cc4fcf1b2e66a2da1fa45195d17e45b40712aba06fcf"} Jul 09 14:55:57.242933 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242916 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"a33c7e814f26179aad409baad80ee7459ba4cf242ea77ae26b9a016a9b7ebef8"} Jul 09 14:55:57.243001 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"1f90f63ac71e5373f7ae779e78d06d9a91daf01fa9e154f53d678bf9b444bba7"} Jul 09 14:55:57.243001 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.242978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"98bfd7ffefe94e62deeaa291d8f9324ac31e89a836e24d3f9e24f1692a18fc0a"} Jul 09 14:55:57.244276 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.244258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdcjs" event={"ID":"5f97c5d2-8209-40c5-b489-a5bbedf4b624","Type":"ContainerStarted","Data":"25a57715671b2af5b10d8ef65f5dcecf8c17c1df96d4d47a616b7be941aabbd7"} Jul 09 14:55:57.245757 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.245733 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2zl2k" event={"ID":"67dc6bf3-f1a5-4881-b9b7-d0ecba8c13f2","Type":"ContainerStarted","Data":"faa87ef9028db2d6dec7225ef110edf471f1b122190295c95c756978a0e0b941"} Jul 09 14:55:57.250284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.250238 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-241.ec2.internal" podStartSLOduration=22.250224841 podStartE2EDuration="22.250224841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.250051479 +0000 UTC m=+23.864635325" watchObservedRunningTime="2026-07-09 14:55:57.250224841 +0000 UTC m=+23.864808696" Jul 09 14:55:57.274179 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.274127 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2zl2k" podStartSLOduration=4.595697223 podStartE2EDuration="23.274110495s" totalImagesPullingTime="18.678413272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.273787766 +0000 UTC m=+23.888371630" watchObservedRunningTime="2026-07-09 14:55:57.274110495 +0000 UTC m=+23.888694350" Jul 09 14:55:57.294124 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.294057 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mdcjs" podStartSLOduration=7.570192533 podStartE2EDuration="23.294035188s" totalImagesPullingTime="15.723842655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.293379203 +0000 UTC m=+23.907963059" watchObservedRunningTime="2026-07-09 14:55:57.294035188 +0000 UTC m=+23.908619044" Jul 09 14:55:57.339674 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.339626 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9mlsj" podStartSLOduration=4.700974797 podStartE2EDuration="23.339605539s" totalImagesPullingTime="18.638630742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.339574452 +0000 UTC m=+23.954158329" watchObservedRunningTime="2026-07-09 14:55:57.339605539 +0000 UTC m=+23.954189394" Jul 09 14:55:57.339844 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.339794 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q62rf" podStartSLOduration=3.442978131 podStartE2EDuration="23.339788462s" totalImagesPullingTime="19.896810331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.316019793 +0000 UTC m=+23.930603649" watchObservedRunningTime="2026-07-09 14:55:57.339788462 +0000 UTC m=+23.954372316" Jul 09 14:55:57.369916 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.369889 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:55:57.387606 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.387548 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j8ppp" podStartSLOduration=3.508182126 podStartE2EDuration="23.38753301s" totalImagesPullingTime="19.879350884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:57.387168343 +0000 UTC m=+24.001752198" watchObservedRunningTime="2026-07-09 14:55:57.38753301 +0000 UTC m=+24.002116865" Jul 09 14:55:57.920483 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.920318 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:55:57.369906164Z","UUID":"0bdef225-c248-4d63-af3f-9a19e9df0945","Handler":null,"Name":"","Endpoint":""} Jul 09 14:55:57.922026 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.921996 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:55:57.922148 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:57.922041 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:55:58.092281 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:58.092246 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:55:58.092601 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:58.092255 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:55:58.092601 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:58.092371 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:55:58.092601 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:58.092464 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:55:58.249921 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:58.249830 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" event={"ID":"68465bae-380b-4227-9d42-a3031b4cb1ef","Type":"ContainerStarted","Data":"8601f000320ddd0a6dc79901dc847603bbc6a89538fc1c910fb2b7685bbf9e16"} Jul 09 14:55:58.251444 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:58.251350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w2zs6" event={"ID":"f0402d59-5961-43d3-8720-d050b4bc7148","Type":"ContainerStarted","Data":"ed7cfa21216de15778e7ef8024c14f46c87f5029f0961f20480ed715e12208af"} Jul 09 14:55:59.092454 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.092417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:55:59.092631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:55:59.092576 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:55:59.258332 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.258227 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"e4dab7c1ba21d5cd5459504d4511033854b403489de7485d621cb172b16ce453"} Jul 09 14:55:59.260682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.260644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" event={"ID":"68465bae-380b-4227-9d42-a3031b4cb1ef","Type":"ContainerStarted","Data":"57114ca782bebea7e7267744cab830af5e47e4921c7fbf90a3ce75a15dc23dce"} Jul 09 14:55:59.285521 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.285456 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w2zs6" podStartSLOduration=5.354657964 podStartE2EDuration="25.285434762s" totalImagesPullingTime="19.930776798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:58.272659037 +0000 UTC m=+24.887242893" watchObservedRunningTime="2026-07-09 14:55:59.285434762 +0000 UTC m=+25.900018615" Jul 09 14:55:59.286272 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.286239 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59vdm" podStartSLOduration=3.293780392 podStartE2EDuration="25.286228219s" totalImagesPullingTime="21.992447827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:59.285235898 +0000 UTC m=+25.899819767" watchObservedRunningTime="2026-07-09 14:55:59.286228219 +0000 UTC m=+25.900812075" Jul 09 14:55:59.795577 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.795529 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:55:59.796348 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:55:59.796322 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:56:00.092524 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:00.092285 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:00.092724 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:00.092342 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:00.092724 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:00.092624 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:00.092724 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:00.092665 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:56:00.263525 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:00.263429 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:56:00.263829 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:00.263808 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9mlsj" Jul 09 14:56:01.091971 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:01.091931 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:01.092218 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:01.092076 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:56:02.091745 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.091557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:02.092734 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.091609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:02.092734 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:02.091828 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:02.092734 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:02.091894 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:56:02.269274 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.269187 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="7d78309fe76b61e84ad4511894692a61171c913f82ed6ad64647517b91d3648a" exitCode=0 Jul 09 14:56:02.269444 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.269275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"7d78309fe76b61e84ad4511894692a61171c913f82ed6ad64647517b91d3648a"} Jul 09 14:56:02.275330 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.275162 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" event={"ID":"90e57f2f-eeb1-491b-99c2-892c00809dc0","Type":"ContainerStarted","Data":"1627940d4cd4677fe5ee1629e258620cc0a49877f52c85465294d4450b024309"} Jul 09 14:56:02.276339 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.276306 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:02.276469 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.276399 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:02.292023 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.291992 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:02.295942 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.295919 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:02.333721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:02.333666 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" podStartSLOduration=8.241142464 podStartE2EDuration="28.333646727s" totalImagesPullingTime="20.092504263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:02.333447134 +0000 UTC m=+28.948030989" watchObservedRunningTime="2026-07-09 14:56:02.333646727 +0000 UTC m=+28.948230582" Jul 09 14:56:03.092220 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.092175 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:03.092829 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:03.092311 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:56:03.277311 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.277283 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:56:03.719841 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.719747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfdgn"] Jul 09 14:56:03.720025 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.719911 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:03.720090 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:03.720049 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:03.720449 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.720427 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfrxt"] Jul 09 14:56:03.720549 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.720535 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:03.720662 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:03.720637 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:56:03.733992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.733959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdhd2"] Jul 09 14:56:03.734189 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:03.734068 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:03.734189 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:03.734165 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:56:04.281541 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:04.281503 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="563d0fd05a56c1ebf69ebfd6a2bbf3bdf08a9ba5ef3aa284211fd3b7ad7f322e" exitCode=0 Jul 09 14:56:04.282074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:04.281592 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"563d0fd05a56c1ebf69ebfd6a2bbf3bdf08a9ba5ef3aa284211fd3b7ad7f322e"} Jul 09 14:56:04.282074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:04.281738 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:56:04.290068 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:04.290041 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:05.092106 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:05.092073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:05.092306 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:05.092210 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:06.092095 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:06.091884 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:06.092634 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:06.091944 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:06.092634 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:06.092198 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:56:06.092634 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:06.092262 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:56:06.288289 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:06.288253 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="aaaed4cd8492ec44625ee576db880a5a495ee99558a3bf33216a51602a08112e" exitCode=0 Jul 09 14:56:06.288479 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:06.288309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"aaaed4cd8492ec44625ee576db880a5a495ee99558a3bf33216a51602a08112e"} Jul 09 14:56:07.091825 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:07.091784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:07.092026 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.091909 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:07.626361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:07.626184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:07.626361 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.626363 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:56:07.627029 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.626464 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:39.626444299 +0000 UTC m=+66.241028151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:56:07.727073 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:07.727019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:07.727278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:07.727114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:07.727278 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727202 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:56:07.727278 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727226 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:56:07.727278 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727236 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xxc4h for pod openshift-network-diagnostics/network-check-target-jfrxt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:56:07.727278 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727246 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:56:07.727500 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727299 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h podName:5874bf49-7cc9-4ebd-b553-dc293bd3c6fa nodeName:}" failed. No retries permitted until 2026-07-09 14:56:39.727278888 +0000 UTC m=+66.341862744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxc4h" (UniqueName: "kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h") pod "network-check-target-jfrxt" (UID: "5874bf49-7cc9-4ebd-b553-dc293bd3c6fa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:56:07.727500 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:07.727318 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret podName:ace0a276-2479-4e01-9a67-7361156c2c2b nodeName:}" failed. No retries permitted until 2026-07-09 14:56:39.727310678 +0000 UTC m=+66.341894511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret") pod "global-pull-secret-syncer-hfdgn" (UID: "ace0a276-2479-4e01-9a67-7361156c2c2b") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:56:08.091617 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:08.091580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:08.091800 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:08.091580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:08.091800 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:08.091720 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfrxt" podUID="5874bf49-7cc9-4ebd-b553-dc293bd3c6fa" Jul 09 14:56:08.091937 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:08.091808 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdhd2" podUID="7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6" Jul 09 14:56:09.092206 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.092164 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:09.092710 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:09.092304 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdgn" podUID="ace0a276-2479-4e01-9a67-7361156c2c2b" Jul 09 14:56:09.877651 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.877616 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-241.ec2.internal" event="NodeReady" Jul 09 14:56:09.877832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.877785 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:56:09.937735 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.937647 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jd7jt"] Jul 09 14:56:09.940379 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.940312 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:09.941342 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.941316 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jb9nv"] Jul 09 14:56:09.943519 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.943495 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:09.944962 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.944933 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:56:09.945281 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.945258 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:56:09.946498 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.946471 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\"" Jul 09 14:56:09.946627 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.946536 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:56:09.946627 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.946559 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:56:09.946627 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.946561 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:56:09.946788 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.946578 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qmd6h\"" Jul 09 14:56:09.960696 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.960616 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jb9nv"] Jul 09 14:56:09.961437 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:09.961410 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd7jt"] Jul 09 14:56:10.045651 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5bf3d-2011-4ad5-8854-7560770716d9-cert\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.045651 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35cb6495-0bdc-489a-b709-506000990103-config-volume\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.045912 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.045912 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lzx\" (UniqueName: \"kubernetes.io/projected/35cb6495-0bdc-489a-b709-506000990103-kube-api-access-q6lzx\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.045912 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmkp4\" (UniqueName: \"kubernetes.io/projected/4ef5bf3d-2011-4ad5-8854-7560770716d9-kube-api-access-vmkp4\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.046035 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.045911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35cb6495-0bdc-489a-b709-506000990103-tmp-dir\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.095697 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.095668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:10.095697 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.095689 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:10.099340 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.099308 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:56:10.099608 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.099572 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:56:10.099716 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.099650 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:56:10.099716 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.099670 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\"" Jul 09 14:56:10.099941 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.099922 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\"" Jul 09 14:56:10.147065 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35cb6495-0bdc-489a-b709-506000990103-tmp-dir\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.147065 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5bf3d-2011-4ad5-8854-7560770716d9-cert\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.147324 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35cb6495-0bdc-489a-b709-506000990103-config-volume\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.147324 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.147324 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147142 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lzx\" (UniqueName: \"kubernetes.io/projected/35cb6495-0bdc-489a-b709-506000990103-kube-api-access-q6lzx\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.147324 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmkp4\" (UniqueName: \"kubernetes.io/projected/4ef5bf3d-2011-4ad5-8854-7560770716d9-kube-api-access-vmkp4\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.147549 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:10.147327 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:10.147549 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:10.147433 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:10.647407652 +0000 UTC m=+37.261991503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:10.147549 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147509 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35cb6495-0bdc-489a-b709-506000990103-tmp-dir\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.147831 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.147809 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35cb6495-0bdc-489a-b709-506000990103-config-volume\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.152431 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.152384 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5bf3d-2011-4ad5-8854-7560770716d9-cert\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.160011 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.159978 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lzx\" (UniqueName: \"kubernetes.io/projected/35cb6495-0bdc-489a-b709-506000990103-kube-api-access-q6lzx\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.160168 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.160128 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmkp4\" (UniqueName: \"kubernetes.io/projected/4ef5bf3d-2011-4ad5-8854-7560770716d9-kube-api-access-vmkp4\") pod \"ingress-canary-jb9nv\" (UID: \"4ef5bf3d-2011-4ad5-8854-7560770716d9\") " pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.261298 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.261204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jb9nv" Jul 09 14:56:10.453303 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.452920 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jb9nv"] Jul 09 14:56:10.457527 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:56:10.457490 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef5bf3d_2011_4ad5_8854_7560770716d9.slice/crio-0fb14acd9f2b723ec94bb3be0d7ddaa8d04b5b503904699e1456724527de460f WatchSource:0}: Error finding container 0fb14acd9f2b723ec94bb3be0d7ddaa8d04b5b503904699e1456724527de460f: Status 404 returned error can't find the container with id 0fb14acd9f2b723ec94bb3be0d7ddaa8d04b5b503904699e1456724527de460f Jul 09 14:56:10.653646 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:10.653607 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:10.653798 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:10.653731 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:10.653798 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:10.653786 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:11.653771036 +0000 UTC m=+38.268354869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:11.092057 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.092017 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:11.095643 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.095616 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:56:11.305664 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.305623 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jb9nv" event={"ID":"4ef5bf3d-2011-4ad5-8854-7560770716d9","Type":"ContainerStarted","Data":"0fb14acd9f2b723ec94bb3be0d7ddaa8d04b5b503904699e1456724527de460f"} Jul 09 14:56:11.308993 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.308960 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="3bf587cea75cc0edfbfc766da1ccb1c9a10badd25508c7410d6bc1cafe3e3124" exitCode=0 Jul 09 14:56:11.309159 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.309024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"3bf587cea75cc0edfbfc766da1ccb1c9a10badd25508c7410d6bc1cafe3e3124"} Jul 09 14:56:11.662681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:11.662581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:11.662836 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:11.662773 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:11.662889 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:11.662858 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:13.662835578 +0000 UTC m=+40.277419434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:12.315032 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:12.314993 2568 generic.go:356] "Generic (PLEG): container finished" podID="cfbda6d1-ca22-4467-8c97-a85fea9f6517" containerID="beb6feb794204c53bbb834522418fcca323fe6bded4d44e4c6d0e1f0ae9d4c84" exitCode=0 Jul 09 14:56:12.315622 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:12.315057 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerDied","Data":"beb6feb794204c53bbb834522418fcca323fe6bded4d44e4c6d0e1f0ae9d4c84"} Jul 09 14:56:13.322052 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:13.321772 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" event={"ID":"cfbda6d1-ca22-4467-8c97-a85fea9f6517","Type":"ContainerStarted","Data":"16e0eda430856d392a8ded77bf5c0c7b839df6ef2478b11514d0b96d316b0b3b"} Jul 09 14:56:13.323354 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:13.323325 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jb9nv" event={"ID":"4ef5bf3d-2011-4ad5-8854-7560770716d9","Type":"ContainerStarted","Data":"2b8a97594e936fe05805988090481f6bc123f5922c715927c629a3cbfcf9030c"} Jul 09 14:56:13.349649 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:13.349537 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jjmxk" podStartSLOduration=8.513032798 podStartE2EDuration="39.349519293s" totalImagesPullingTime="30.836486495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:13.347614308 +0000 UTC m=+39.962198173" watchObservedRunningTime="2026-07-09 14:56:13.349519293 +0000 UTC m=+39.964103148" Jul 09 14:56:13.366081 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:13.366020 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jb9nv" podStartSLOduration=1.746890711 podStartE2EDuration="4.366003287s" totalImagesPullingTime="2.619112576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:13.365239154 +0000 UTC m=+39.979823020" watchObservedRunningTime="2026-07-09 14:56:13.366003287 +0000 UTC m=+39.980587195" Jul 09 14:56:13.679258 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:13.679156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:13.679485 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:13.679298 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:13.679485 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:13.679385 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:17.679365329 +0000 UTC m=+44.293949161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:17.710117 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:17.710075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:17.710712 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:17.710185 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:17.710712 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:17.710256 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:25.71024103 +0000 UTC m=+52.324824862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:25.766949 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:25.766903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:25.767520 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:25.767046 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:25.767520 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:25.767113 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:41.767096891 +0000 UTC m=+68.381680724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:35.295071 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:35.295039 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d25h7" Jul 09 14:56:39.666958 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.666919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:56:39.670135 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.670110 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:56:39.677571 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:39.677543 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:56:39.677643 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:39.677632 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs podName:7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:43.677611503 +0000 UTC m=+130.292195336 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs") pod "network-metrics-daemon-vdhd2" (UID: "7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6") : secret "metrics-daemon-secret" not found Jul 09 14:56:39.767214 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.767173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:39.767340 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.767246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:39.770413 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.770380 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:56:39.770468 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.770380 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:56:39.780124 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.780096 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:56:39.781451 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.781427 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ace0a276-2479-4e01-9a67-7361156c2c2b-original-pull-secret\") pod \"global-pull-secret-syncer-hfdgn\" (UID: \"ace0a276-2479-4e01-9a67-7361156c2c2b\") " pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:39.790692 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.790655 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxc4h\" (UniqueName: \"kubernetes.io/projected/5874bf49-7cc9-4ebd-b553-dc293bd3c6fa-kube-api-access-xxc4h\") pod \"network-check-target-jfrxt\" (UID: \"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa\") " pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:39.811805 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.811773 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\"" Jul 09 14:56:39.819434 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.819408 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:39.903703 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.903674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdgn" Jul 09 14:56:39.955591 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:39.955548 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfrxt"] Jul 09 14:56:39.958575 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:56:39.958544 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5874bf49_7cc9_4ebd_b553_dc293bd3c6fa.slice/crio-467f6b70b4c19730676f26098ba4bd946cf07c83b1f7b7c570c45a7fa15d6f96 WatchSource:0}: Error finding container 467f6b70b4c19730676f26098ba4bd946cf07c83b1f7b7c570c45a7fa15d6f96: Status 404 returned error can't find the container with id 467f6b70b4c19730676f26098ba4bd946cf07c83b1f7b7c570c45a7fa15d6f96 Jul 09 14:56:40.034597 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:40.034561 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfdgn"] Jul 09 14:56:40.037583 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:56:40.037550 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace0a276_2479_4e01_9a67_7361156c2c2b.slice/crio-a523397c523d7dccdc8ba01f6cd417ddd9225613ca4f4db1925231bb41e3c772 WatchSource:0}: Error finding container a523397c523d7dccdc8ba01f6cd417ddd9225613ca4f4db1925231bb41e3c772: Status 404 returned error can't find the container with id a523397c523d7dccdc8ba01f6cd417ddd9225613ca4f4db1925231bb41e3c772 Jul 09 14:56:40.389740 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:40.389684 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfrxt" event={"ID":"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa","Type":"ContainerStarted","Data":"467f6b70b4c19730676f26098ba4bd946cf07c83b1f7b7c570c45a7fa15d6f96"} Jul 09 14:56:40.391109 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:40.391066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfdgn" event={"ID":"ace0a276-2479-4e01-9a67-7361156c2c2b","Type":"ContainerStarted","Data":"a523397c523d7dccdc8ba01f6cd417ddd9225613ca4f4db1925231bb41e3c772"} Jul 09 14:56:41.781609 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:41.781538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:56:41.782114 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:41.781676 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:41.782114 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:56:41.781781 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:13.781755031 +0000 UTC m=+100.396338882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:56:45.406527 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:45.406483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfdgn" event={"ID":"ace0a276-2479-4e01-9a67-7361156c2c2b","Type":"ContainerStarted","Data":"556817fab8752b1981e4a179042ea0ab277f5424d245885f4f75f6661630623f"} Jul 09 14:56:45.408020 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:45.407993 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfrxt" event={"ID":"5874bf49-7cc9-4ebd-b553-dc293bd3c6fa","Type":"ContainerStarted","Data":"7847864f507760aa2827f08f48d3498803111a3c52b791f86380f91609658c6a"} Jul 09 14:56:45.408155 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:45.408131 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:56:45.426279 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:56:45.426215 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hfdgn" podStartSLOduration=67.036607209 podStartE2EDuration="1m11.426196196s" totalImagesPullingTime="4.389588987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:45.424682728 +0000 UTC m=+72.039266595" watchObservedRunningTime="2026-07-09 14:56:45.426196196 +0000 UTC m=+72.040780051" Jul 09 14:57:10.678768 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.678609 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfrxt" podStartSLOduration=92.215539306 podStartE2EDuration="1m36.678591225s" totalImagesPullingTime="4.463051919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:45.442045623 +0000 UTC m=+72.056629477" watchObservedRunningTime="2026-07-09 14:57:10.678591225 +0000 UTC m=+97.293175080" Jul 09 14:57:10.679293 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.679271 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5968cb5cc4-cbdz6"] Jul 09 14:57:10.683757 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.683740 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.686717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.686687 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:57:10.687267 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bx579\"" Jul 09 14:57:10.687368 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 14:57:10.687368 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687254 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 14:57:10.687929 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 14:57:10.687929 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:57:10.687998 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.687929 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 14:57:10.719086 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.719018 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5968cb5cc4-cbdz6"] Jul 09 14:57:10.787524 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787489 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx"] Jul 09 14:57:10.787727 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.787772 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-default-certificate\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.787805 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-stats-auth\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.787848 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb5hs\" (UniqueName: \"kubernetes.io/projected/21f143ed-764c-4902-9b39-83dd30c071b9-kube-api-access-fb5hs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.787890 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.787876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.790291 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.790278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.792073 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.792053 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk"] Jul 09 14:57:10.794671 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.794654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.799273 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.799255 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:57:10.799544 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.799529 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:57:10.800509 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.800480 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 14:57:10.800509 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.800502 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t7bcl\"" Jul 09 14:57:10.800659 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.800581 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 14:57:10.802457 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.802438 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 14:57:10.802560 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.802442 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 14:57:10.802934 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.802719 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:57:10.802934 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.802728 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8mmpk\"" Jul 09 14:57:10.803060 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.803002 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 14:57:10.819243 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.819206 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx"] Jul 09 14:57:10.838441 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.838384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk"] Jul 09 14:57:10.888869 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.888815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.888869 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.888875 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmt9\" (UniqueName: \"kubernetes.io/projected/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-kube-api-access-njmt9\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.888973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-default-certificate\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-stats-auth\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070c6a5-2cab-4576-acd6-480601d09be6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtx8\" (UniqueName: \"kubernetes.io/projected/f070c6a5-2cab-4576-acd6-480601d09be6-kube-api-access-cwtx8\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.889097 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb5hs\" (UniqueName: \"kubernetes.io/projected/21f143ed-764c-4902-9b39-83dd30c071b9-kube-api-access-fb5hs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.889420 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:10.889125 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.389105748 +0000 UTC m=+98.003689598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:10.889865 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.889865 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:10.889683 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:10.889865 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889695 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.889865 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:10.889825 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.389803042 +0000 UTC m=+98.004386891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : secret "router-metrics-certs-default" not found Jul 09 14:57:10.890145 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.889742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070c6a5-2cab-4576-acd6-480601d09be6-config\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.893442 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.892488 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-default-certificate\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.894339 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.894316 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-stats-auth\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.897645 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.897622 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km"] Jul 09 14:57:10.900551 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.900534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:10.903749 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.903725 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 14:57:10.904303 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.904286 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 14:57:10.904453 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.904429 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:57:10.904569 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.904457 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fngzd\"" Jul 09 14:57:10.904656 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.904638 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 14:57:10.910908 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.910882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb5hs\" (UniqueName: \"kubernetes.io/projected/21f143ed-764c-4902-9b39-83dd30c071b9-kube-api-access-fb5hs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:10.922247 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.922213 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km"] Jul 09 14:57:10.991356 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070c6a5-2cab-4576-acd6-480601d09be6-config\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.991356 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97zs\" (UniqueName: \"kubernetes.io/projected/b0810b54-b7f7-41e6-81a8-45569999d858-kube-api-access-t97zs\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:10.991356 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.991356 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0810b54-b7f7-41e6-81a8-45569999d858-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:10.991356 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmt9\" (UniqueName: \"kubernetes.io/projected/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-kube-api-access-njmt9\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.991682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070c6a5-2cab-4576-acd6-480601d09be6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.991682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtx8\" (UniqueName: \"kubernetes.io/projected/f070c6a5-2cab-4576-acd6-480601d09be6-kube-api-access-cwtx8\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.991762 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.991762 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0810b54-b7f7-41e6-81a8-45569999d858-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:10.991836 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:10.991795 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:10.991878 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:10.991872 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls podName:53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.491853624 +0000 UTC m=+98.106437462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6vcgx" (UID: "53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:10.991965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.991949 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070c6a5-2cab-4576-acd6-480601d09be6-config\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:10.992126 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.992110 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:10.993879 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:10.993858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070c6a5-2cab-4576-acd6-480601d09be6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:11.001776 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.001748 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmt9\" (UniqueName: \"kubernetes.io/projected/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-kube-api-access-njmt9\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:11.001922 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.001791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtx8\" (UniqueName: \"kubernetes.io/projected/f070c6a5-2cab-4576-acd6-480601d09be6-kube-api-access-cwtx8\") pod \"service-ca-operator-7695fc6c8c-r67zk\" (UID: \"f070c6a5-2cab-4576-acd6-480601d09be6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:11.092145 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.092107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0810b54-b7f7-41e6-81a8-45569999d858-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.092145 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.092151 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97zs\" (UniqueName: \"kubernetes.io/projected/b0810b54-b7f7-41e6-81a8-45569999d858-kube-api-access-t97zs\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.092373 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.092181 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0810b54-b7f7-41e6-81a8-45569999d858-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.092831 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.092810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0810b54-b7f7-41e6-81a8-45569999d858-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.094467 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.094450 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0810b54-b7f7-41e6-81a8-45569999d858-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.101816 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.101784 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97zs\" (UniqueName: \"kubernetes.io/projected/b0810b54-b7f7-41e6-81a8-45569999d858-kube-api-access-t97zs\") pod \"kube-storage-version-migrator-operator-799cb7f958-992km\" (UID: \"b0810b54-b7f7-41e6-81a8-45569999d858\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.105722 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.105702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" Jul 09 14:57:11.209882 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.209837 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" Jul 09 14:57:11.236219 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.236175 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk"] Jul 09 14:57:11.239639 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:11.239607 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf070c6a5_2cab_4576_acd6_480601d09be6.slice/crio-e0d5764e52c6da00ae9a7e6c0906dfd9c3d13c9613b27d32b9e83af55315a2b5 WatchSource:0}: Error finding container e0d5764e52c6da00ae9a7e6c0906dfd9c3d13c9613b27d32b9e83af55315a2b5: Status 404 returned error can't find the container with id e0d5764e52c6da00ae9a7e6c0906dfd9c3d13c9613b27d32b9e83af55315a2b5 Jul 09 14:57:11.340857 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.340820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km"] Jul 09 14:57:11.343923 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:11.343896 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0810b54_b7f7_41e6_81a8_45569999d858.slice/crio-38506352082cffdae15afc0443ca33ec6a157b7a7e933e20a10117975cb47ac9 WatchSource:0}: Error finding container 38506352082cffdae15afc0443ca33ec6a157b7a7e933e20a10117975cb47ac9: Status 404 returned error can't find the container with id 38506352082cffdae15afc0443ca33ec6a157b7a7e933e20a10117975cb47ac9 Jul 09 14:57:11.395133 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.395091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:11.395301 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.395156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:11.395301 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:11.395255 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:11.395301 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:11.395274 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.395256539 +0000 UTC m=+99.009840373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:11.395451 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:11.395308 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.395295168 +0000 UTC m=+99.009879043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : secret "router-metrics-certs-default" not found Jul 09 14:57:11.471830 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.471790 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" event={"ID":"b0810b54-b7f7-41e6-81a8-45569999d858","Type":"ContainerStarted","Data":"38506352082cffdae15afc0443ca33ec6a157b7a7e933e20a10117975cb47ac9"} Jul 09 14:57:11.472918 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.472883 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" event={"ID":"f070c6a5-2cab-4576-acd6-480601d09be6","Type":"ContainerStarted","Data":"e0d5764e52c6da00ae9a7e6c0906dfd9c3d13c9613b27d32b9e83af55315a2b5"} Jul 09 14:57:11.496428 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:11.496332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:11.496546 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:11.496502 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:11.496583 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:11.496569 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls podName:53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.496554445 +0000 UTC m=+99.111138278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6vcgx" (UID: "53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:12.402869 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:12.402834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:12.403344 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:12.402900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:12.403344 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:12.403050 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:12.403344 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:12.403059 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:14.403035918 +0000 UTC m=+101.017619776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:12.403344 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:12.403105 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:14.403090059 +0000 UTC m=+101.017673891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : secret "router-metrics-certs-default" not found Jul 09 14:57:12.503582 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:12.503537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:12.503776 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:12.503718 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:12.503835 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:12.503807 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls podName:53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:14.503785189 +0000 UTC m=+101.118369023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6vcgx" (UID: "53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:13.814295 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:13.814270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:57:13.814645 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:13.814464 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:57:13.814645 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:13.814550 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls podName:35cb6495-0bdc-489a-b709-506000990103 nodeName:}" failed. No retries permitted until 2026-07-09 14:58:17.814527918 +0000 UTC m=+164.429111768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls") pod "dns-default-jd7jt" (UID: "35cb6495-0bdc-489a-b709-506000990103") : secret "dns-default-metrics-tls" not found Jul 09 14:57:14.418997 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.418952 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:14.419217 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.419043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:14.419217 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.419113 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:14.419217 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.419156 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.419142265 +0000 UTC m=+105.033726099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:14.419217 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.419174 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.419165299 +0000 UTC m=+105.033749133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : secret "router-metrics-certs-default" not found Jul 09 14:57:14.484188 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.484144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" event={"ID":"b0810b54-b7f7-41e6-81a8-45569999d858","Type":"ContainerStarted","Data":"13be7cbbc7b2c23920612932eae2ef165b2978d971d09491ca5dd0cf274071b5"} Jul 09 14:57:14.485674 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.485644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" event={"ID":"f070c6a5-2cab-4576-acd6-480601d09be6","Type":"ContainerStarted","Data":"8d1944483eaa778f5a0a38460650f1fad4814b8fabf814236623ce2cc131d4b3"} Jul 09 14:57:14.503761 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.503707 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" podStartSLOduration=2.085345389 podStartE2EDuration="4.503689517s" totalImagesPullingTime="2.418344128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:14.501744892 +0000 UTC m=+101.116328744" watchObservedRunningTime="2026-07-09 14:57:14.503689517 +0000 UTC m=+101.118273350" Jul 09 14:57:14.519815 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.519771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:14.520002 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.519985 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:14.520095 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.520083 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls podName:53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.5200623 +0000 UTC m=+105.134646132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6vcgx" (UID: "53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:14.717369 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.717252 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" podStartSLOduration=2.193012172 podStartE2EDuration="4.717233991s" totalImagesPullingTime="2.524221819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:14.522089687 +0000 UTC m=+101.136673543" watchObservedRunningTime="2026-07-09 14:57:14.717233991 +0000 UTC m=+101.331817845" Jul 09 14:57:14.717962 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.717944 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-67bkd"] Jul 09 14:57:14.722690 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.722667 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.725766 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.725748 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:57:14.726492 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.726466 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:57:14.726624 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.726466 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:57:14.726624 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.726587 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:57:14.726713 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.726636 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dh2jv\"" Jul 09 14:57:14.732999 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.732973 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67bkd"] Jul 09 14:57:14.822292 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.821941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.822292 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.821988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.822292 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.822062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fac2573-987b-40c3-bfbf-6b0c6840456d-crio-socket\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.822292 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.822091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fac2573-987b-40c3-bfbf-6b0c6840456d-data-volume\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.822292 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.822115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9z4\" (UniqueName: \"kubernetes.io/projected/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-api-access-lj9z4\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923649 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923649 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fac2573-987b-40c3-bfbf-6b0c6840456d-crio-socket\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fac2573-987b-40c3-bfbf-6b0c6840456d-data-volume\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9z4\" (UniqueName: \"kubernetes.io/projected/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-api-access-lj9z4\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.923756 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.923836 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.423819585 +0000 UTC m=+102.038403461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : configmap "kube-rbac-proxy" not found Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.923836 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fac2573-987b-40c3-bfbf-6b0c6840456d-crio-socket\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.923930 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.923895 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:14.924296 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:14.923950 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.423935396 +0000 UTC m=+102.038519242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:14.924296 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.924152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fac2573-987b-40c3-bfbf-6b0c6840456d-data-volume\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:14.933779 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:14.933756 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9z4\" (UniqueName: \"kubernetes.io/projected/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-api-access-lj9z4\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:15.069284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.069246 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8"] Jul 09 14:57:15.087782 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.087746 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8"] Jul 09 14:57:15.087957 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.087880 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" Jul 09 14:57:15.093034 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.093010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9f8jb\"" Jul 09 14:57:15.226738 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.226698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwbr\" (UniqueName: \"kubernetes.io/projected/5beabd39-c273-4016-b819-e17b6c1082b7-kube-api-access-mxwbr\") pod \"network-check-source-869dcfcdcd-jtjs8\" (UID: \"5beabd39-c273-4016-b819-e17b6c1082b7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" Jul 09 14:57:15.327504 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.327378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwbr\" (UniqueName: \"kubernetes.io/projected/5beabd39-c273-4016-b819-e17b6c1082b7-kube-api-access-mxwbr\") pod \"network-check-source-869dcfcdcd-jtjs8\" (UID: \"5beabd39-c273-4016-b819-e17b6c1082b7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" Jul 09 14:57:15.337327 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.337288 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwbr\" (UniqueName: \"kubernetes.io/projected/5beabd39-c273-4016-b819-e17b6c1082b7-kube-api-access-mxwbr\") pod \"network-check-source-869dcfcdcd-jtjs8\" (UID: \"5beabd39-c273-4016-b819-e17b6c1082b7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" Jul 09 14:57:15.397444 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.397374 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" Jul 09 14:57:15.428802 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.428768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:15.428969 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.428807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:15.428969 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:15.428920 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:15.428969 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:15.428932 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:15.429091 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:15.428992 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.428977686 +0000 UTC m=+103.043561518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:15.429091 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:15.429008 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.428999933 +0000 UTC m=+103.043583766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : configmap "kube-rbac-proxy" not found Jul 09 14:57:15.542028 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:15.541988 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8"] Jul 09 14:57:15.544790 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:15.544758 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5beabd39_c273_4016_b819_e17b6c1082b7.slice/crio-a543bdc0a2c27cf1afb8737ce8b61a5054f2d7000fbe9a8ab32d0d05c2241030 WatchSource:0}: Error finding container a543bdc0a2c27cf1afb8737ce8b61a5054f2d7000fbe9a8ab32d0d05c2241030: Status 404 returned error can't find the container with id a543bdc0a2c27cf1afb8737ce8b61a5054f2d7000fbe9a8ab32d0d05c2241030 Jul 09 14:57:16.412889 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.412856 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfrxt" Jul 09 14:57:16.438492 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.438456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:16.438492 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.438494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:16.438740 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:16.438578 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:16.438740 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:16.438622 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:16.438740 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:16.438651 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.43863103 +0000 UTC m=+105.053214883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : configmap "kube-rbac-proxy" not found Jul 09 14:57:16.438740 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:16.438679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.438660277 +0000 UTC m=+105.053244110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:16.494693 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.494659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" event={"ID":"5beabd39-c273-4016-b819-e17b6c1082b7","Type":"ContainerStarted","Data":"f22069e2f99665cde488bba0eea19c89461880c2b7001ff74a0716300aa6f475"} Jul 09 14:57:16.494912 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.494718 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" event={"ID":"5beabd39-c273-4016-b819-e17b6c1082b7","Type":"ContainerStarted","Data":"a543bdc0a2c27cf1afb8737ce8b61a5054f2d7000fbe9a8ab32d0d05c2241030"} Jul 09 14:57:16.513918 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.513855 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jtjs8" podStartSLOduration=1.5138322880000001 podStartE2EDuration="1.513832288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:16.513603722 +0000 UTC m=+103.128187578" watchObservedRunningTime="2026-07-09 14:57:16.513832288 +0000 UTC m=+103.128416144" Jul 09 14:57:16.677970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:16.677887 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8ppp_86327973-5c1a-4dc5-ad80-6284239e5969/dns-node-resolver/0.log" Jul 09 14:57:17.279514 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.279477 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qxkmt"] Jul 09 14:57:17.294579 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.294543 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qxkmt"] Jul 09 14:57:17.294756 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.294673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.297511 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.297484 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nrvfm\"" Jul 09 14:57:17.297743 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.297523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 14:57:17.297743 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.297530 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 14:57:17.298680 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.298654 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 14:57:17.298802 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.298692 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 14:57:17.448943 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.448899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-cabundle\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.449331 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.448965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-key\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.449331 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.449070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj854\" (UniqueName: \"kubernetes.io/projected/490ee8f2-b6e5-446e-89c5-f799b046c832-kube-api-access-rj854\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.550168 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.550076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-cabundle\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.550168 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.550143 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-key\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.550365 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.550191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj854\" (UniqueName: \"kubernetes.io/projected/490ee8f2-b6e5-446e-89c5-f799b046c832-kube-api-access-rj854\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.550902 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.550879 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-cabundle\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.552728 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.552705 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/490ee8f2-b6e5-446e-89c5-f799b046c832-signing-key\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.560455 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.560425 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj854\" (UniqueName: \"kubernetes.io/projected/490ee8f2-b6e5-446e-89c5-f799b046c832-kube-api-access-rj854\") pod \"service-ca-79f68b9f4f-qxkmt\" (UID: \"490ee8f2-b6e5-446e-89c5-f799b046c832\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.605052 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.605006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" Jul 09 14:57:17.677327 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.677302 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdcjs_5f97c5d2-8209-40c5-b489-a5bbedf4b624/node-ca/0.log" Jul 09 14:57:17.752026 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:17.751998 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qxkmt"] Jul 09 14:57:17.754372 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:17.754343 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490ee8f2_b6e5_446e_89c5_f799b046c832.slice/crio-cb871403fedfee678ffbc2d8fe402b408ef0db3ce185dbb61a447b66f5d11a1c WatchSource:0}: Error finding container cb871403fedfee678ffbc2d8fe402b408ef0db3ce185dbb61a447b66f5d11a1c: Status 404 returned error can't find the container with id cb871403fedfee678ffbc2d8fe402b408ef0db3ce185dbb61a447b66f5d11a1c Jul 09 14:57:18.459962 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.459922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.459977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.460022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.460072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460083 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460150 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.46013349 +0000 UTC m=+113.074717366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : secret "router-metrics-certs-default" not found Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460180 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460187 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460182 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle podName:21f143ed-764c-4902-9b39-83dd30c071b9 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.460156239 +0000 UTC m=+113.074740073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle") pod "router-default-5968cb5cc4-cbdz6" (UID: "21f143ed-764c-4902-9b39-83dd30c071b9") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460248 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.460233812 +0000 UTC m=+109.074817648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : configmap "kube-rbac-proxy" not found Jul 09 14:57:18.460478 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.460264 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.460254467 +0000 UTC m=+109.074838306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:18.503450 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.503414 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" event={"ID":"490ee8f2-b6e5-446e-89c5-f799b046c832","Type":"ContainerStarted","Data":"49c948d8b442747a2890710584df9725c4c39f5122d68c07e39f953e022eeee6"} Jul 09 14:57:18.503675 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.503465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" event={"ID":"490ee8f2-b6e5-446e-89c5-f799b046c832","Type":"ContainerStarted","Data":"cb871403fedfee678ffbc2d8fe402b408ef0db3ce185dbb61a447b66f5d11a1c"} Jul 09 14:57:18.528137 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.528076 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-qxkmt" podStartSLOduration=1.528052936 podStartE2EDuration="1.528052936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:18.527022943 +0000 UTC m=+105.141606799" watchObservedRunningTime="2026-07-09 14:57:18.528052936 +0000 UTC m=+105.142636792" Jul 09 14:57:18.561095 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.561055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:18.561253 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.561206 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:18.561295 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:18.561271 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls podName:53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.561256634 +0000 UTC m=+113.175840471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6vcgx" (UID: "53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:57:18.678188 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:18.678124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jb9nv_4ef5bf3d-2011-4ad5-8854-7560770716d9/serve-healthcheck-canary/0.log" Jul 09 14:57:22.497203 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:22.497163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:22.497631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:22.497290 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:22.497631 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:22.497322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:22.497631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:22.497364 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.497344448 +0000 UTC m=+117.111928301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : configmap "kube-rbac-proxy" not found Jul 09 14:57:22.497631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:22.497454 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:22.497631 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:22.497504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls podName:0fac2573-987b-40c3-bfbf-6b0c6840456d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.497491916 +0000 UTC m=+117.112075763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67bkd" (UID: "0fac2573-987b-40c3-bfbf-6b0c6840456d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:26.532320 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.532282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:26.532320 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.532327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:26.533001 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.532979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f143ed-764c-4902-9b39-83dd30c071b9-service-ca-bundle\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:26.534812 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.534787 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f143ed-764c-4902-9b39-83dd30c071b9-metrics-certs\") pod \"router-default-5968cb5cc4-cbdz6\" (UID: \"21f143ed-764c-4902-9b39-83dd30c071b9\") " pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:26.592947 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.592885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:26.633141 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.633100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:26.635603 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.635573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6vcgx\" (UID: \"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:26.700777 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.700743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" Jul 09 14:57:26.731324 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.731206 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5968cb5cc4-cbdz6"] Jul 09 14:57:26.735589 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:26.735557 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f143ed_764c_4902_9b39_83dd30c071b9.slice/crio-dc39f531d5b1e66f0c081794a046441e7777d21bb357baad4384dfcd361ca3b6 WatchSource:0}: Error finding container dc39f531d5b1e66f0c081794a046441e7777d21bb357baad4384dfcd361ca3b6: Status 404 returned error can't find the container with id dc39f531d5b1e66f0c081794a046441e7777d21bb357baad4384dfcd361ca3b6 Jul 09 14:57:26.839510 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:26.839474 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx"] Jul 09 14:57:26.842542 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:26.842510 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ef0581_7b5b_4a22_9c7d_1b43cf4e5b93.slice/crio-1b2b523ba72384efa03e340309e3ebdfc523f49069c170932592b953737136d9 WatchSource:0}: Error finding container 1b2b523ba72384efa03e340309e3ebdfc523f49069c170932592b953737136d9: Status 404 returned error can't find the container with id 1b2b523ba72384efa03e340309e3ebdfc523f49069c170932592b953737136d9 Jul 09 14:57:27.538136 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.538094 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" event={"ID":"21f143ed-764c-4902-9b39-83dd30c071b9","Type":"ContainerStarted","Data":"c38f21ac7aa58be14bf31a1a269df156c656e6837c8facbad44b10f27e77cbab"} Jul 09 14:57:27.538615 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.538158 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" event={"ID":"21f143ed-764c-4902-9b39-83dd30c071b9","Type":"ContainerStarted","Data":"dc39f531d5b1e66f0c081794a046441e7777d21bb357baad4384dfcd361ca3b6"} Jul 09 14:57:27.539689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.539652 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" event={"ID":"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93","Type":"ContainerStarted","Data":"1b2b523ba72384efa03e340309e3ebdfc523f49069c170932592b953737136d9"} Jul 09 14:57:27.593847 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.593812 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:27.596876 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.596850 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:27.620485 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:27.620418 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" podStartSLOduration=17.620380627 podStartE2EDuration="17.620380627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:27.568566322 +0000 UTC m=+114.183150179" watchObservedRunningTime="2026-07-09 14:57:27.620380627 +0000 UTC m=+114.234964484" Jul 09 14:57:28.545719 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:28.545679 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" event={"ID":"53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93","Type":"ContainerStarted","Data":"c85a32e5c5951c1854aad815a4ad72bde2f5694f7f95366bab4cf337b48550bb"} Jul 09 14:57:28.546504 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:28.545815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:28.547237 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:28.547211 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5968cb5cc4-cbdz6" Jul 09 14:57:28.579874 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:28.579818 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6vcgx" podStartSLOduration=17.029954092 podStartE2EDuration="18.579802717s" totalImagesPullingTime="1.549848625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:28.577859943 +0000 UTC m=+115.192443799" watchObservedRunningTime="2026-07-09 14:57:28.579802717 +0000 UTC m=+115.194386571" Jul 09 14:57:30.571170 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.571127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:30.571170 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.571179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:30.571688 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.571671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fac2573-987b-40c3-bfbf-6b0c6840456d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:30.573578 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.573558 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fac2573-987b-40c3-bfbf-6b0c6840456d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67bkd\" (UID: \"0fac2573-987b-40c3-bfbf-6b0c6840456d\") " pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:30.631863 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.631824 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67bkd" Jul 09 14:57:30.771205 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:30.771170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67bkd"] Jul 09 14:57:30.774436 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:30.774409 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fac2573_987b_40c3_bfbf_6b0c6840456d.slice/crio-5123c4a91395b05c141515c592d61626325e8121e32d945546c88af9fa730ef9 WatchSource:0}: Error finding container 5123c4a91395b05c141515c592d61626325e8121e32d945546c88af9fa730ef9: Status 404 returned error can't find the container with id 5123c4a91395b05c141515c592d61626325e8121e32d945546c88af9fa730ef9 Jul 09 14:57:31.559953 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:31.559908 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67bkd" event={"ID":"0fac2573-987b-40c3-bfbf-6b0c6840456d","Type":"ContainerStarted","Data":"5123c4a91395b05c141515c592d61626325e8121e32d945546c88af9fa730ef9"} Jul 09 14:57:34.572313 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:34.572275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67bkd" event={"ID":"0fac2573-987b-40c3-bfbf-6b0c6840456d","Type":"ContainerStarted","Data":"86902eaa54ccb267f21d459a2fd0fbac06a996cca1286012a1c408c7eac37d13"} Jul 09 14:57:35.576412 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:35.576362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67bkd" event={"ID":"0fac2573-987b-40c3-bfbf-6b0c6840456d","Type":"ContainerStarted","Data":"81d3dc530dc9e2badb524a8fb0c6c67c8dac036ab57e8f7b8fa49650e58f8383"} Jul 09 14:57:38.591287 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:38.591233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67bkd" event={"ID":"0fac2573-987b-40c3-bfbf-6b0c6840456d","Type":"ContainerStarted","Data":"dd640891de977b196ebe52691c025ef1998b182f4557c7db83cbae2683aacb09"} Jul 09 14:57:38.612945 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:38.612873 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-67bkd" podStartSLOduration=17.974929289 podStartE2EDuration="24.612853805s" totalImagesPullingTime="6.637924516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:38.6125281 +0000 UTC m=+125.227111955" watchObservedRunningTime="2026-07-09 14:57:38.612853805 +0000 UTC m=+125.227437661" Jul 09 14:57:40.221371 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.221324 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-4nrg7"] Jul 09 14:57:40.224557 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.224538 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:57:40.228278 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.228243 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:57:40.228460 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.228436 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:57:40.228558 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.228544 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cfpmw\"" Jul 09 14:57:40.250759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.250729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g684m\" (UniqueName: \"kubernetes.io/projected/6de59182-b80e-4a4a-8048-51e79adeb67c-kube-api-access-g684m\") pod \"downloads-68c9cbb497-4nrg7\" (UID: \"6de59182-b80e-4a4a-8048-51e79adeb67c\") " pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:57:40.291690 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.291655 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4nrg7"] Jul 09 14:57:40.348414 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.348359 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c9c79577d-g6qvn"] Jul 09 14:57:40.351426 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.351382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g684m\" (UniqueName: \"kubernetes.io/projected/6de59182-b80e-4a4a-8048-51e79adeb67c-kube-api-access-g684m\") pod \"downloads-68c9cbb497-4nrg7\" (UID: \"6de59182-b80e-4a4a-8048-51e79adeb67c\") " pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:57:40.351677 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.351661 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.357200 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.357175 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:57:40.357345 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.357318 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gfkwb\"" Jul 09 14:57:40.358256 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.357925 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:57:40.358526 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.358508 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:57:40.366221 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.366191 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:57:40.375021 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.374988 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9c79577d-g6qvn"] Jul 09 14:57:40.382181 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.382156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g684m\" (UniqueName: \"kubernetes.io/projected/6de59182-b80e-4a4a-8048-51e79adeb67c-kube-api-access-g684m\") pod \"downloads-68c9cbb497-4nrg7\" (UID: \"6de59182-b80e-4a4a-8048-51e79adeb67c\") " pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:57:40.452823 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-image-registry-private-configuration\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.452823 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97lw\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-kube-api-access-l97lw\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.452823 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-tls\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.453079 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1832f05-48c4-4cda-b06f-7434cec2f73c-ca-trust-extracted\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.453079 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-trusted-ca\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.453079 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-bound-sa-token\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.453079 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-certificates\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.453079 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.452995 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-installation-pull-secrets\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.533992 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.533952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:57:40.554105 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-image-registry-private-configuration\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554105 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97lw\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-kube-api-access-l97lw\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554347 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-tls\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554466 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1832f05-48c4-4cda-b06f-7434cec2f73c-ca-trust-extracted\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554466 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-trusted-ca\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554577 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554491 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-bound-sa-token\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554644 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-certificates\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554747 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-installation-pull-secrets\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.554824 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.554786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1832f05-48c4-4cda-b06f-7434cec2f73c-ca-trust-extracted\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.555500 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.555475 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-certificates\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.555710 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.555684 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1832f05-48c4-4cda-b06f-7434cec2f73c-trusted-ca\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.557238 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.557203 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-image-registry-private-configuration\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.557354 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.557288 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-registry-tls\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.557435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.557349 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1832f05-48c4-4cda-b06f-7434cec2f73c-installation-pull-secrets\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.565754 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.565727 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-bound-sa-token\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.568166 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.568146 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97lw\" (UniqueName: \"kubernetes.io/projected/c1832f05-48c4-4cda-b06f-7434cec2f73c-kube-api-access-l97lw\") pod \"image-registry-7c9c79577d-g6qvn\" (UID: \"c1832f05-48c4-4cda-b06f-7434cec2f73c\") " pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.661216 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.661186 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:40.675974 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.675942 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4nrg7"] Jul 09 14:57:40.679038 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:40.679012 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de59182_b80e_4a4a_8048_51e79adeb67c.slice/crio-fd48ba2c9d815fe5cc24a4b9837f28be1c535f2cd43d29f7a444e61b99f4e9d3 WatchSource:0}: Error finding container fd48ba2c9d815fe5cc24a4b9837f28be1c535f2cd43d29f7a444e61b99f4e9d3: Status 404 returned error can't find the container with id fd48ba2c9d815fe5cc24a4b9837f28be1c535f2cd43d29f7a444e61b99f4e9d3 Jul 09 14:57:40.811690 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:40.811656 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9c79577d-g6qvn"] Jul 09 14:57:40.814751 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:40.814720 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1832f05_48c4_4cda_b06f_7434cec2f73c.slice/crio-f786350765011f8ebee859dc46a6b93ebc84dc4d6479a6ef5bf30e503a6a392b WatchSource:0}: Error finding container f786350765011f8ebee859dc46a6b93ebc84dc4d6479a6ef5bf30e503a6a392b: Status 404 returned error can't find the container with id f786350765011f8ebee859dc46a6b93ebc84dc4d6479a6ef5bf30e503a6a392b Jul 09 14:57:41.603951 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:41.603908 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" event={"ID":"c1832f05-48c4-4cda-b06f-7434cec2f73c","Type":"ContainerStarted","Data":"dddab46db69185f7ffbd468e2df5fc0595c324976e7bca06ad04b4bdb950e715"} Jul 09 14:57:41.604490 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:41.604014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" event={"ID":"c1832f05-48c4-4cda-b06f-7434cec2f73c","Type":"ContainerStarted","Data":"f786350765011f8ebee859dc46a6b93ebc84dc4d6479a6ef5bf30e503a6a392b"} Jul 09 14:57:41.604490 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:41.604041 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:57:41.605429 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:41.605380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4nrg7" event={"ID":"6de59182-b80e-4a4a-8048-51e79adeb67c","Type":"ContainerStarted","Data":"fd48ba2c9d815fe5cc24a4b9837f28be1c535f2cd43d29f7a444e61b99f4e9d3"} Jul 09 14:57:41.630054 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:41.630000 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" podStartSLOduration=1.6299806669999999 podStartE2EDuration="1.629980667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:41.628799047 +0000 UTC m=+128.243382903" watchObservedRunningTime="2026-07-09 14:57:41.629980667 +0000 UTC m=+128.244564513" Jul 09 14:57:43.678568 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:43.678525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:57:43.681145 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:43.681117 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6-metrics-certs\") pod \"network-metrics-daemon-vdhd2\" (UID: \"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6\") " pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:57:43.717275 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:43.717236 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\"" Jul 09 14:57:43.723895 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:43.723862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdhd2" Jul 09 14:57:43.896373 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:43.896336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdhd2"] Jul 09 14:57:43.900053 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:43.900025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7128c2a2_5a67_4a4e_8185_49bfe8d8d4a6.slice/crio-84ce30ff5ecb19d88bef1ac3d87887fa619bca48cce696a9ccdfd86505fc411e WatchSource:0}: Error finding container 84ce30ff5ecb19d88bef1ac3d87887fa619bca48cce696a9ccdfd86505fc411e: Status 404 returned error can't find the container with id 84ce30ff5ecb19d88bef1ac3d87887fa619bca48cce696a9ccdfd86505fc411e Jul 09 14:57:44.619561 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:44.619521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdhd2" event={"ID":"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6","Type":"ContainerStarted","Data":"84ce30ff5ecb19d88bef1ac3d87887fa619bca48cce696a9ccdfd86505fc411e"} Jul 09 14:57:45.625534 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:45.625490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdhd2" event={"ID":"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6","Type":"ContainerStarted","Data":"3af1d044141dfc603da7a3899a47aa63f0f7177b2a73afeea3323b3adc612255"} Jul 09 14:57:45.625946 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:45.625562 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdhd2" event={"ID":"7128c2a2-5a67-4a4e-8185-49bfe8d8d4a6","Type":"ContainerStarted","Data":"68f849343db864a543c8e8ba2a34b94e57dd31fda2ccbb4c716210ed4058068d"} Jul 09 14:57:45.646687 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:45.646625 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdhd2" podStartSLOduration=130.327182474 podStartE2EDuration="2m11.64660284s" totalImagesPullingTime="1.319420366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:45.646443988 +0000 UTC m=+132.261027845" watchObservedRunningTime="2026-07-09 14:57:45.64660284 +0000 UTC m=+132.261186694" Jul 09 14:57:47.422459 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.422415 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z57vd"] Jul 09 14:57:47.426269 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.425931 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.431913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.431882 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 14:57:47.432231 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.432212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 14:57:47.433090 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.432765 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:57:47.433090 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.432961 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:57:47.433350 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.433090 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d4zb8\"" Jul 09 14:57:47.433512 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.433485 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s2tkm"] Jul 09 14:57:47.443022 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.441986 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z57vd"] Jul 09 14:57:47.443022 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.442125 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.445600 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.445578 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:57:47.446279 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.445868 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qkgqz\"" Jul 09 14:57:47.446279 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.445922 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:57:47.446279 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.446127 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:57:47.515289 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.515289 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-metrics-client-ca\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5fkv\" (UniqueName: \"kubernetes.io/projected/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-api-access-w5fkv\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-textfile\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65n5k\" (UniqueName: \"kubernetes.io/projected/708599f9-6219-4de4-bc88-f2fa5d0d69ca-kube-api-access-65n5k\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-wtmp\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-tls\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-sys\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-root\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09e2719e-2829-42e3-854a-3863e98a5ab3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.516115 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.515839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617078 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09e2719e-2829-42e3-854a-3863e98a5ab3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-metrics-client-ca\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5fkv\" (UniqueName: \"kubernetes.io/projected/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-api-access-w5fkv\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-textfile\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65n5k\" (UniqueName: \"kubernetes.io/projected/708599f9-6219-4de4-bc88-f2fa5d0d69ca-kube-api-access-65n5k\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617357 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-wtmp\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-tls\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-sys\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-root\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.617901 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.617631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-root\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.618333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.618220 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-metrics-client-ca\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.618573 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.618450 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09e2719e-2829-42e3-854a-3863e98a5ab3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.618573 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.618555 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.618778 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.618718 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-textfile\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.619099 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.619124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-wtmp\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.619185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708599f9-6219-4de4-bc88-f2fa5d0d69ca-sys\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:47.619201 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.619214 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e2719e-2829-42e3-854a-3863e98a5ab3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.619285 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:57:47.619262 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls podName:09e2719e-2829-42e3-854a-3863e98a5ab3 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:48.119242317 +0000 UTC m=+134.733826152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-z57vd" (UID: "09e2719e-2829-42e3-854a-3863e98a5ab3") : secret "kube-state-metrics-tls" not found Jul 09 14:57:47.622252 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.622197 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.623405 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.623344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/708599f9-6219-4de4-bc88-f2fa5d0d69ca-node-exporter-tls\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.623830 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.623804 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.635647 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.635613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5fkv\" (UniqueName: \"kubernetes.io/projected/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-api-access-w5fkv\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:47.637953 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.637923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65n5k\" (UniqueName: \"kubernetes.io/projected/708599f9-6219-4de4-bc88-f2fa5d0d69ca-kube-api-access-65n5k\") pod \"node-exporter-s2tkm\" (UID: \"708599f9-6219-4de4-bc88-f2fa5d0d69ca\") " pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.758129 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:47.757810 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s2tkm" Jul 09 14:57:47.771549 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:47.771514 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708599f9_6219_4de4_bc88_f2fa5d0d69ca.slice/crio-52e94672116a57000f07630d7ff6902c4a04bc0c3acf7066ab39dd55bf83f2b7 WatchSource:0}: Error finding container 52e94672116a57000f07630d7ff6902c4a04bc0c3acf7066ab39dd55bf83f2b7: Status 404 returned error can't find the container with id 52e94672116a57000f07630d7ff6902c4a04bc0c3acf7066ab39dd55bf83f2b7 Jul 09 14:57:48.123001 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.122965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:48.125873 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.125839 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e2719e-2829-42e3-854a-3863e98a5ab3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z57vd\" (UID: \"09e2719e-2829-42e3-854a-3863e98a5ab3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:48.346048 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.345746 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" Jul 09 14:57:48.511202 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.510679 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:57:48.515045 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.515014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.518825 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.518506 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:57:48.518825 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.518576 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:57:48.518825 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.518506 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:57:48.519884 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.519453 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:57:48.519884 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.519507 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:57:48.519884 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.519733 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:57:48.521056 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.520630 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:57:48.521056 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.520681 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:57:48.521056 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.520885 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tf5rd\"" Jul 09 14:57:48.521463 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.521441 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:57:48.539447 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.539315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:57:48.554071 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.554044 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z57vd"] Jul 09 14:57:48.628514 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628514 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.628965 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.628948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49fvp\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.643832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.643754 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2tkm" event={"ID":"708599f9-6219-4de4-bc88-f2fa5d0d69ca","Type":"ContainerStarted","Data":"52e94672116a57000f07630d7ff6902c4a04bc0c3acf7066ab39dd55bf83f2b7"} Jul 09 14:57:48.729599 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729496 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729599 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729599 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729612 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.729872 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.729866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49fvp\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.731786 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.731754 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.733883 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.733853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.734582 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.734537 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.734807 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.734781 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.735050 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.735013 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.735536 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.735493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.735834 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.735811 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.735934 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.735811 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.737598 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.737475 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.737721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.737667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.738076 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.738053 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.738277 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.738235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.740508 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.740466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49fvp\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp\") pod \"alertmanager-main-0\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:48.802224 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:48.802183 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e2719e_2829_42e3_854a_3863e98a5ab3.slice/crio-50a0760f65652fd67581951900d2ed9499307ffe6d64710f083ed55f839d4ed5 WatchSource:0}: Error finding container 50a0760f65652fd67581951900d2ed9499307ffe6d64710f083ed55f839d4ed5: Status 404 returned error can't find the container with id 50a0760f65652fd67581951900d2ed9499307ffe6d64710f083ed55f839d4ed5 Jul 09 14:57:48.831143 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:48.831106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:57:49.024748 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:49.024720 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:57:49.051564 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:49.051528 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d55c71_188d_4041_bedd_6102a400c1b4.slice/crio-f7fc3e42d7bea0648c0de1ff8d0e5defac363cb3ad620e89c4d5cfc9ede93359 WatchSource:0}: Error finding container f7fc3e42d7bea0648c0de1ff8d0e5defac363cb3ad620e89c4d5cfc9ede93359: Status 404 returned error can't find the container with id f7fc3e42d7bea0648c0de1ff8d0e5defac363cb3ad620e89c4d5cfc9ede93359 Jul 09 14:57:49.650693 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:49.650586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"f7fc3e42d7bea0648c0de1ff8d0e5defac363cb3ad620e89c4d5cfc9ede93359"} Jul 09 14:57:49.652174 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:49.652041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" event={"ID":"09e2719e-2829-42e3-854a-3863e98a5ab3","Type":"ContainerStarted","Data":"50a0760f65652fd67581951900d2ed9499307ffe6d64710f083ed55f839d4ed5"} Jul 09 14:57:49.654237 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:49.654186 2568 generic.go:356] "Generic (PLEG): container finished" podID="708599f9-6219-4de4-bc88-f2fa5d0d69ca" containerID="2cc98fa9a173b033918abf52284642152667411595ad5d49faba1aa0cc93e2ba" exitCode=0 Jul 09 14:57:49.654237 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:49.654221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2tkm" event={"ID":"708599f9-6219-4de4-bc88-f2fa5d0d69ca","Type":"ContainerDied","Data":"2cc98fa9a173b033918abf52284642152667411595ad5d49faba1aa0cc93e2ba"} Jul 09 14:57:50.167773 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.167682 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:57:50.171302 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.171273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.174061 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174030 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mblkz\"" Jul 09 14:57:50.174913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174339 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:57:50.174913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:57:50.174913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174406 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:57:50.174913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174416 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:57:50.174913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.174748 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:57:50.188102 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.188074 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:57:50.188530 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.188500 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:57:50.245143 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245002 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245143 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245143 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245489 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245489 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245489 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkn54\" (UniqueName: \"kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.245489 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.245360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346521 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkn54\" (UniqueName: \"kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.346721 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.347504 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.346732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.349082 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.348141 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.349082 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.348562 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.349082 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.348603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.349082 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.348992 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.351796 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.351749 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.352671 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.352645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.358139 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.358082 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkn54\" (UniqueName: \"kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54\") pod \"console-6c9496c6c8-gbpcz\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.485366 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.485288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:57:50.682581 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.681419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" event={"ID":"09e2719e-2829-42e3-854a-3863e98a5ab3","Type":"ContainerStarted","Data":"50f97d33ac7208d8c5dfc6239e5fd49df2a02ca67e51bd278e51903c228fe67c"} Jul 09 14:57:50.686114 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.686054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2tkm" event={"ID":"708599f9-6219-4de4-bc88-f2fa5d0d69ca","Type":"ContainerStarted","Data":"4cab3bd78c9473175d6f7ccc32ad756716ff02e84ef51f6970aee1a0c47b1376"} Jul 09 14:57:50.686495 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.686370 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2tkm" event={"ID":"708599f9-6219-4de4-bc88-f2fa5d0d69ca","Type":"ContainerStarted","Data":"4a07a0f778bfe817cd7e62335211df05b08f3736dd14ab354f0fe1b7ad4b4611"} Jul 09 14:57:50.688929 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.688845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4"} Jul 09 14:57:50.732714 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.732619 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s2tkm" podStartSLOduration=2.57166099 podStartE2EDuration="3.732593508s" totalImagesPullingTime="1.075149835s" totalInitContainerRuntime="85.782683ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:50.729913145 +0000 UTC m=+137.344497025" watchObservedRunningTime="2026-07-09 14:57:50.732593508 +0000 UTC m=+137.347177364" Jul 09 14:57:50.767419 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:50.767371 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:57:50.770818 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:57:50.770729 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51400b56_2266_425e_98e3_7b271f885a04.slice/crio-a339958164c956e56c359fe295e6fdb0c6d2e49250c995c1be2b8eceb31bb3ea WatchSource:0}: Error finding container a339958164c956e56c359fe295e6fdb0c6d2e49250c995c1be2b8eceb31bb3ea: Status 404 returned error can't find the container with id a339958164c956e56c359fe295e6fdb0c6d2e49250c995c1be2b8eceb31bb3ea Jul 09 14:57:51.697139 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.697094 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" event={"ID":"09e2719e-2829-42e3-854a-3863e98a5ab3","Type":"ContainerStarted","Data":"994cfe144efee474eae35a74826bfc503ca684f0f26077c71aee58b3cb116b63"} Jul 09 14:57:51.697666 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.697179 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" event={"ID":"09e2719e-2829-42e3-854a-3863e98a5ab3","Type":"ContainerStarted","Data":"110b2ce7facb7b34c3a3acbc58dc249205540d681a328e584d9bbbc4ab4f8a48"} Jul 09 14:57:51.699999 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.699923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9496c6c8-gbpcz" event={"ID":"51400b56-2266-425e-98e3-7b271f885a04","Type":"ContainerStarted","Data":"a339958164c956e56c359fe295e6fdb0c6d2e49250c995c1be2b8eceb31bb3ea"} Jul 09 14:57:51.703986 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.703171 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4" exitCode=0 Jul 09 14:57:51.703986 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.703272 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4"} Jul 09 14:57:51.722543 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:51.721885 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-z57vd" podStartSLOduration=2.991347674 podStartE2EDuration="4.721857813s" totalImagesPullingTime="1.730510139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:51.72151596 +0000 UTC m=+138.336099819" watchObservedRunningTime="2026-07-09 14:57:51.721857813 +0000 UTC m=+138.336441670" Jul 09 14:57:52.230421 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.230312 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l"] Jul 09 14:57:52.235301 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.235270 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.238147 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.237945 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zdp59\"" Jul 09 14:57:52.238990 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.238968 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 14:57:52.245368 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.244899 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l"] Jul 09 14:57:52.369722 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.369676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqj75\" (UniqueName: \"kubernetes.io/projected/7105030a-ceff-4c0a-bdbb-86c5f4a68256-kube-api-access-pqj75\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.369905 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.369754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7105030a-ceff-4c0a-bdbb-86c5f4a68256-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.470346 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.470290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqj75\" (UniqueName: \"kubernetes.io/projected/7105030a-ceff-4c0a-bdbb-86c5f4a68256-kube-api-access-pqj75\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.470581 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.470426 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7105030a-ceff-4c0a-bdbb-86c5f4a68256-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.473952 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.473916 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7105030a-ceff-4c0a-bdbb-86c5f4a68256-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.480826 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.480742 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqj75\" (UniqueName: \"kubernetes.io/projected/7105030a-ceff-4c0a-bdbb-86c5f4a68256-kube-api-access-pqj75\") pod \"monitoring-plugin-5f68df7f58-bj68l\" (UID: \"7105030a-ceff-4c0a-bdbb-86c5f4a68256\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:52.549841 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:52.549803 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:57:56.226413 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.226354 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:57:56.230214 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.230189 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.241911 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.241885 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:57:56.308773 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308735 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.308773 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.309038 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.309038 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9gln\" (UniqueName: \"kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.309038 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.309038 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.308997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.309195 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.309054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.409998 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.409957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410190 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410190 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410190 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410190 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gln\" (UniqueName: \"kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410190 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.410499 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.411018 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.410989 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.411123 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.411018 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.411123 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.411042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.411791 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.411769 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.413043 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.413016 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.413139 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.413042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.423759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.423733 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9gln\" (UniqueName: \"kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln\") pod \"console-5b6d5c8b6c-zsrhw\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:57:56.542879 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:57:56.542780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:58:00.594096 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.593976 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l"] Jul 09 14:58:00.597513 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:58:00.597467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7105030a_ceff_4c0a_bdbb_86c5f4a68256.slice/crio-fe00814e6bffa4804333821645e740d817700a0c9cdeb6d3295d908a222d8f36 WatchSource:0}: Error finding container fe00814e6bffa4804333821645e740d817700a0c9cdeb6d3295d908a222d8f36: Status 404 returned error can't find the container with id fe00814e6bffa4804333821645e740d817700a0c9cdeb6d3295d908a222d8f36 Jul 09 14:58:00.646588 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.646558 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:58:00.651000 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:58:00.650965 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62499960_358d_4e1e_912f_f0f82e50e6d8.slice/crio-9e45eba7a14cb82d36028015862bca4a213f6adcda0694518fd333a192bcb73c WatchSource:0}: Error finding container 9e45eba7a14cb82d36028015862bca4a213f6adcda0694518fd333a192bcb73c: Status 404 returned error can't find the container with id 9e45eba7a14cb82d36028015862bca4a213f6adcda0694518fd333a192bcb73c Jul 09 14:58:00.744916 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.744783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4nrg7" event={"ID":"6de59182-b80e-4a4a-8048-51e79adeb67c","Type":"ContainerStarted","Data":"eae2342390989d3f28aebf48a6f209ad732013e2ec764e789a0c9af7cf13a359"} Jul 09 14:58:00.745493 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.745473 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:58:00.748518 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.747736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9496c6c8-gbpcz" event={"ID":"51400b56-2266-425e-98e3-7b271f885a04","Type":"ContainerStarted","Data":"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8"} Jul 09 14:58:00.752518 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.752464 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58"} Jul 09 14:58:00.752672 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.752575 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0"} Jul 09 14:58:00.752672 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.752622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71"} Jul 09 14:58:00.754010 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.753981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" event={"ID":"7105030a-ceff-4c0a-bdbb-86c5f4a68256","Type":"ContainerStarted","Data":"fe00814e6bffa4804333821645e740d817700a0c9cdeb6d3295d908a222d8f36"} Jul 09 14:58:00.756383 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.756347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d5c8b6c-zsrhw" event={"ID":"62499960-358d-4e1e-912f-f0f82e50e6d8","Type":"ContainerStarted","Data":"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9"} Jul 09 14:58:00.756513 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.756416 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d5c8b6c-zsrhw" event={"ID":"62499960-358d-4e1e-912f-f0f82e50e6d8","Type":"ContainerStarted","Data":"9e45eba7a14cb82d36028015862bca4a213f6adcda0694518fd333a192bcb73c"} Jul 09 14:58:00.756958 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.756935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-4nrg7" Jul 09 14:58:00.766162 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.765570 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-4nrg7" podStartSLOduration=0.970495218 podStartE2EDuration="20.765550452s" totalImagesPullingTime="19.795055234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:00.765096262 +0000 UTC m=+147.379680120" watchObservedRunningTime="2026-07-09 14:58:00.765550452 +0000 UTC m=+147.380134307" Jul 09 14:58:00.795956 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.795895 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b6d5c8b6c-zsrhw" podStartSLOduration=4.795875619 podStartE2EDuration="4.795875619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:00.792892229 +0000 UTC m=+147.407476097" watchObservedRunningTime="2026-07-09 14:58:00.795875619 +0000 UTC m=+147.410459452" Jul 09 14:58:00.850898 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:00.850816 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c9496c6c8-gbpcz" podStartSLOduration=1.207896603 podStartE2EDuration="10.850772467s" totalImagesPullingTime="9.642875864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:00.848100259 +0000 UTC m=+147.462684114" watchObservedRunningTime="2026-07-09 14:58:00.850772467 +0000 UTC m=+147.465356326" Jul 09 14:58:01.768759 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:01.768724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc"} Jul 09 14:58:01.769317 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:01.768804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a"} Jul 09 14:58:02.614691 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:02.614657 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c9c79577d-g6qvn" Jul 09 14:58:02.777667 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:02.777552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" event={"ID":"7105030a-ceff-4c0a-bdbb-86c5f4a68256","Type":"ContainerStarted","Data":"96863e8ae85a965beff1eadda521f7b0131f8e1e859809632cb66219987985ee"} Jul 09 14:58:02.778104 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:02.777836 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:58:02.783841 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:02.783791 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" Jul 09 14:58:02.801409 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:02.801324 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bj68l" podStartSLOduration=8.956828686 podStartE2EDuration="10.801300862s" totalImagesPullingTime="1.844472176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:02.799424952 +0000 UTC m=+149.414008809" watchObservedRunningTime="2026-07-09 14:58:02.801300862 +0000 UTC m=+149.415884716" Jul 09 14:58:03.787429 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:03.787373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerStarted","Data":"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8"} Jul 09 14:58:03.828463 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:03.827512 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.284222589 podStartE2EDuration="15.82748769s" totalImagesPullingTime="13.52184294s" totalInitContainerRuntime="21.422161ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:03.825810799 +0000 UTC m=+150.440394694" watchObservedRunningTime="2026-07-09 14:58:03.82748769 +0000 UTC m=+150.442071549" Jul 09 14:58:06.543125 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:06.543083 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:58:06.543617 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:06.543159 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:58:06.548791 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:06.548761 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:58:06.807660 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:06.807558 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:58:06.864985 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:06.864933 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:58:10.486526 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:10.486486 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:58:12.955051 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:58:12.955006 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jd7jt" podUID="35cb6495-0bdc-489a-b709-506000990103" Jul 09 14:58:13.831962 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:13.831931 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:17.820499 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:17.820462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:17.822913 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:17.822883 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35cb6495-0bdc-489a-b709-506000990103-metrics-tls\") pod \"dns-default-jd7jt\" (UID: \"35cb6495-0bdc-489a-b709-506000990103\") " pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:18.035808 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:18.035774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\"" Jul 09 14:58:18.043398 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:18.043354 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:18.217272 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:18.217245 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd7jt"] Jul 09 14:58:18.219424 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:58:18.219375 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cb6495_0bdc_489a_b709_506000990103.slice/crio-359d6505ee0f9cba146cd3b61449d54681c84cebe5b735d337d7f9d6ad8781e0 WatchSource:0}: Error finding container 359d6505ee0f9cba146cd3b61449d54681c84cebe5b735d337d7f9d6ad8781e0: Status 404 returned error can't find the container with id 359d6505ee0f9cba146cd3b61449d54681c84cebe5b735d337d7f9d6ad8781e0 Jul 09 14:58:18.856874 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:18.856838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd7jt" event={"ID":"35cb6495-0bdc-489a-b709-506000990103","Type":"ContainerStarted","Data":"359d6505ee0f9cba146cd3b61449d54681c84cebe5b735d337d7f9d6ad8781e0"} Jul 09 14:58:21.869567 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:21.869533 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd7jt" event={"ID":"35cb6495-0bdc-489a-b709-506000990103","Type":"ContainerStarted","Data":"f0689c1b9da742a90b56989b286cb0c7a2502268529e5fec95286218f09d5a95"} Jul 09 14:58:21.869984 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:21.869585 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd7jt" event={"ID":"35cb6495-0bdc-489a-b709-506000990103","Type":"ContainerStarted","Data":"b321e1d7e6522b38a6374511ed000d20d77a40b8b13d3857fc3b9e2011da6941"} Jul 09 14:58:21.869984 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:21.869655 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:21.891539 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:21.891490 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jd7jt" podStartSLOduration=130.244846716 podStartE2EDuration="2m12.891469723s" totalImagesPullingTime="2.646623007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:21.890366606 +0000 UTC m=+168.504950489" watchObservedRunningTime="2026-07-09 14:58:21.891469723 +0000 UTC m=+168.506053579" Jul 09 14:58:29.904451 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.904407 2568 generic.go:356] "Generic (PLEG): container finished" podID="b0810b54-b7f7-41e6-81a8-45569999d858" containerID="13be7cbbc7b2c23920612932eae2ef165b2978d971d09491ca5dd0cf274071b5" exitCode=0 Jul 09 14:58:29.904920 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.904479 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" event={"ID":"b0810b54-b7f7-41e6-81a8-45569999d858","Type":"ContainerDied","Data":"13be7cbbc7b2c23920612932eae2ef165b2978d971d09491ca5dd0cf274071b5"} Jul 09 14:58:29.904920 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.904837 2568 scope.go:117] "RemoveContainer" containerID="13be7cbbc7b2c23920612932eae2ef165b2978d971d09491ca5dd0cf274071b5" Jul 09 14:58:29.906170 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.906144 2568 generic.go:356] "Generic (PLEG): container finished" podID="f070c6a5-2cab-4576-acd6-480601d09be6" containerID="8d1944483eaa778f5a0a38460650f1fad4814b8fabf814236623ce2cc131d4b3" exitCode=0 Jul 09 14:58:29.906260 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.906215 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" event={"ID":"f070c6a5-2cab-4576-acd6-480601d09be6","Type":"ContainerDied","Data":"8d1944483eaa778f5a0a38460650f1fad4814b8fabf814236623ce2cc131d4b3"} Jul 09 14:58:29.906608 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:29.906593 2568 scope.go:117] "RemoveContainer" containerID="8d1944483eaa778f5a0a38460650f1fad4814b8fabf814236623ce2cc131d4b3" Jul 09 14:58:30.911754 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:30.911711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-992km" event={"ID":"b0810b54-b7f7-41e6-81a8-45569999d858","Type":"ContainerStarted","Data":"847a008644863387326b721f91fa2fb1989f2516c5120d4b7cdd7e9762dc6229"} Jul 09 14:58:30.913545 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:30.913521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r67zk" event={"ID":"f070c6a5-2cab-4576-acd6-480601d09be6","Type":"ContainerStarted","Data":"7fef09d331614bdd374f40a602aacee38dd1831beea969b875beb4724f4d2e93"} Jul 09 14:58:31.876797 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:31.876765 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jd7jt" Jul 09 14:58:31.892138 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:31.892096 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c9496c6c8-gbpcz" podUID="51400b56-2266-425e-98e3-7b271f885a04" containerName="console" containerID="cri-o://94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8" gracePeriod=15 Jul 09 14:58:32.169516 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.169464 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:58:32.250241 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250204 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkn54\" (UniqueName: \"kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250252 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250295 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250324 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250347 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250371 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250448 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250432 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config\") pod \"51400b56-2266-425e-98e3-7b271f885a04\" (UID: \"51400b56-2266-425e-98e3-7b271f885a04\") " Jul 09 14:58:32.250842 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250815 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca" (OuterVolumeSpecName: "service-ca") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:32.250961 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250823 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:32.250961 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.250909 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:32.251124 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.251014 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config" (OuterVolumeSpecName: "console-config") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:32.252685 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.252655 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54" (OuterVolumeSpecName: "kube-api-access-xkn54") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "kube-api-access-xkn54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:58:32.252900 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.252876 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:58:32.252983 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.252900 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51400b56-2266-425e-98e3-7b271f885a04" (UID: "51400b56-2266-425e-98e3-7b271f885a04"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:58:32.351358 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351314 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-oauth-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351358 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351353 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351358 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351363 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-oauth-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351635 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351373 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-trusted-ca-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351635 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351383 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51400b56-2266-425e-98e3-7b271f885a04-console-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351635 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351424 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkn54\" (UniqueName: \"kubernetes.io/projected/51400b56-2266-425e-98e3-7b271f885a04-kube-api-access-xkn54\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.351635 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.351434 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51400b56-2266-425e-98e3-7b271f885a04-console-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:58:32.923181 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.923137 2568 generic.go:356] "Generic (PLEG): container finished" podID="51400b56-2266-425e-98e3-7b271f885a04" containerID="94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8" exitCode=0 Jul 09 14:58:32.923357 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.923204 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9496c6c8-gbpcz" Jul 09 14:58:32.923357 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.923218 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9496c6c8-gbpcz" event={"ID":"51400b56-2266-425e-98e3-7b271f885a04","Type":"ContainerDied","Data":"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8"} Jul 09 14:58:32.923357 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.923299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9496c6c8-gbpcz" event={"ID":"51400b56-2266-425e-98e3-7b271f885a04","Type":"ContainerDied","Data":"a339958164c956e56c359fe295e6fdb0c6d2e49250c995c1be2b8eceb31bb3ea"} Jul 09 14:58:32.923357 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.923320 2568 scope.go:117] "RemoveContainer" containerID="94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8" Jul 09 14:58:32.933251 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.933234 2568 scope.go:117] "RemoveContainer" containerID="94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8" Jul 09 14:58:32.933592 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:58:32.933570 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8\": container with ID starting with 94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8 not found: ID does not exist" containerID="94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8" Jul 09 14:58:32.933669 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.933606 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8"} err="failed to get container status \"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8\": rpc error: code = NotFound desc = could not find container \"94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8\": container with ID starting with 94145b94fb0a3a6898699ed3bf4ed7a44a5eb58335ef291371dfd50c6f4bc7e8 not found: ID does not exist" Jul 09 14:58:32.945010 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.944973 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:58:32.949685 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:32.949659 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c9496c6c8-gbpcz"] Jul 09 14:58:34.097706 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:58:34.097669 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51400b56-2266-425e-98e3-7b271f885a04" path="/var/lib/kubelet/pods/51400b56-2266-425e-98e3-7b271f885a04/volumes" Jul 09 14:59:07.810072 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810037 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810322 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="alertmanager" containerID="cri-o://8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71" gracePeriod=120 Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810410 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-metric" containerID="cri-o://3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a" gracePeriod=120 Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810444 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy" containerID="cri-o://2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc" gracePeriod=120 Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810472 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="prom-label-proxy" containerID="cri-o://3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8" gracePeriod=120 Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810471 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="config-reloader" containerID="cri-o://1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0" gracePeriod=120 Jul 09 14:59:07.810648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:07.810449 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-web" containerID="cri-o://31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58" gracePeriod=120 Jul 09 14:59:08.062832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062802 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8" exitCode=0 Jul 09 14:59:08.062832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062822 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a" exitCode=0 Jul 09 14:59:08.062832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062828 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc" exitCode=0 Jul 09 14:59:08.062832 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062834 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0" exitCode=0 Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062839 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71" exitCode=0 Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062878 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8"} Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062945 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a"} Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc"} Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.062999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0"} Jul 09 14:59:08.063058 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:08.063021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71"} Jul 09 14:59:09.059343 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.059314 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.069857 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.069817 2568 generic.go:356] "Generic (PLEG): container finished" podID="00d55c71-188d-4041-bedd-6102a400c1b4" containerID="31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58" exitCode=0 Jul 09 14:59:09.070014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.069887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58"} Jul 09 14:59:09.070014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.069903 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.070014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.069959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00d55c71-188d-4041-bedd-6102a400c1b4","Type":"ContainerDied","Data":"f7fc3e42d7bea0648c0de1ff8d0e5defac363cb3ad620e89c4d5cfc9ede93359"} Jul 09 14:59:09.070014 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.069996 2568 scope.go:117] "RemoveContainer" containerID="3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8" Jul 09 14:59:09.078365 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.078345 2568 scope.go:117] "RemoveContainer" containerID="3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a" Jul 09 14:59:09.085892 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.085866 2568 scope.go:117] "RemoveContainer" containerID="2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc" Jul 09 14:59:09.093297 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.093274 2568 scope.go:117] "RemoveContainer" containerID="31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58" Jul 09 14:59:09.102087 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.102062 2568 scope.go:117] "RemoveContainer" containerID="1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0" Jul 09 14:59:09.111284 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.111262 2568 scope.go:117] "RemoveContainer" containerID="8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71" Jul 09 14:59:09.119790 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.119768 2568 scope.go:117] "RemoveContainer" containerID="571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4" Jul 09 14:59:09.127348 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.127327 2568 scope.go:117] "RemoveContainer" containerID="3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8" Jul 09 14:59:09.127695 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.127673 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8\": container with ID starting with 3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8 not found: ID does not exist" containerID="3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8" Jul 09 14:59:09.127773 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.127707 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8"} err="failed to get container status \"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8\": rpc error: code = NotFound desc = could not find container \"3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8\": container with ID starting with 3b15f8fe99f2811a02c29f7fab8ed21396f8e71216f505887f0c338dde96b8e8 not found: ID does not exist" Jul 09 14:59:09.127773 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.127728 2568 scope.go:117] "RemoveContainer" containerID="3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a" Jul 09 14:59:09.128019 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.128001 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a\": container with ID starting with 3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a not found: ID does not exist" containerID="3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a" Jul 09 14:59:09.128078 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128029 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a"} err="failed to get container status \"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a\": rpc error: code = NotFound desc = could not find container \"3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a\": container with ID starting with 3830c185d4a74a630590a9d909b677c59f65c616bb51a9a1a5d13352b653d20a not found: ID does not exist" Jul 09 14:59:09.128078 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128047 2568 scope.go:117] "RemoveContainer" containerID="2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc" Jul 09 14:59:09.128330 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.128310 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc\": container with ID starting with 2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc not found: ID does not exist" containerID="2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc" Jul 09 14:59:09.128415 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128337 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc"} err="failed to get container status \"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc\": rpc error: code = NotFound desc = could not find container \"2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc\": container with ID starting with 2b4e5cc63e99cfd621e78edc05a593cd71f1f865b3d80cd8f28a0e7215c84abc not found: ID does not exist" Jul 09 14:59:09.128415 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128365 2568 scope.go:117] "RemoveContainer" containerID="31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58" Jul 09 14:59:09.128665 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.128647 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58\": container with ID starting with 31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58 not found: ID does not exist" containerID="31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58" Jul 09 14:59:09.128725 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128669 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58"} err="failed to get container status \"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58\": rpc error: code = NotFound desc = could not find container \"31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58\": container with ID starting with 31e6cf32268c6411eb659d108bd17fbc1ce6a33c41428744b219b219de42cf58 not found: ID does not exist" Jul 09 14:59:09.128725 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128685 2568 scope.go:117] "RemoveContainer" containerID="1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0" Jul 09 14:59:09.128927 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.128907 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0\": container with ID starting with 1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0 not found: ID does not exist" containerID="1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0" Jul 09 14:59:09.128985 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128936 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0"} err="failed to get container status \"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0\": rpc error: code = NotFound desc = could not find container \"1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0\": container with ID starting with 1ea4f6791b5b5e0ca892e60acc6c0a70713c175e7458bf50347e903f88c503c0 not found: ID does not exist" Jul 09 14:59:09.128985 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.128959 2568 scope.go:117] "RemoveContainer" containerID="8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71" Jul 09 14:59:09.129208 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.129190 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71\": container with ID starting with 8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71 not found: ID does not exist" containerID="8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71" Jul 09 14:59:09.129263 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.129214 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71"} err="failed to get container status \"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71\": rpc error: code = NotFound desc = could not find container \"8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71\": container with ID starting with 8a85beda9bc89987451f23bd87c2762e50ff662dc0225a4836bca0cf75171c71 not found: ID does not exist" Jul 09 14:59:09.129263 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.129232 2568 scope.go:117] "RemoveContainer" containerID="571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4" Jul 09 14:59:09.129494 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:09.129462 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4\": container with ID starting with 571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4 not found: ID does not exist" containerID="571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4" Jul 09 14:59:09.129593 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.129497 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4"} err="failed to get container status \"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4\": rpc error: code = NotFound desc = could not find container \"571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4\": container with ID starting with 571ea81e83783dc3cab7d242ddcd0677142f2122a17707d6800049ee5e75cfa4 not found: ID does not exist" Jul 09 14:59:09.153938 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.153854 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154081 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.153948 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154081 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.153985 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154081 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154019 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154081 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154057 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49fvp\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154101 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154130 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154160 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154228 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154300 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154273 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.154592 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154434 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:09.154846 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.154818 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:59:09.155405 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.155091 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-main-db\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.155405 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.155116 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.155405 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.155270 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:09.157025 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.157000 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume" (OuterVolumeSpecName: "config-volume") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.157132 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.157053 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp" (OuterVolumeSpecName: "kube-api-access-49fvp") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "kube-api-access-49fvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:59:09.157132 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.157083 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:59:09.157793 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.157763 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.157897 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.157834 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out" (OuterVolumeSpecName: "config-out") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:59:09.158287 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.158270 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.158591 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.158570 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.161973 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.161952 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.256136 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256087 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.256136 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256142 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy\") pod \"00d55c71-188d-4041-bedd-6102a400c1b4\" (UID: \"00d55c71-188d-4041-bedd-6102a400c1b4\") " Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256308 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-main-tls\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256327 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-config-volume\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256340 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00d55c71-188d-4041-bedd-6102a400c1b4-metrics-client-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256362 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49fvp\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-kube-api-access-49fvp\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256376 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-cluster-tls-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256418 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00d55c71-188d-4041-bedd-6102a400c1b4-tls-assets\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256435 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256433 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256446 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.256682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.256459 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00d55c71-188d-4041-bedd-6102a400c1b4-config-out\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.258208 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.258185 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.268521 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.268485 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config" (OuterVolumeSpecName: "web-config") pod "00d55c71-188d-4041-bedd-6102a400c1b4" (UID: "00d55c71-188d-4041-bedd-6102a400c1b4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:09.357301 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.357250 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-web-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.357301 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.357296 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00d55c71-188d-4041-bedd-6102a400c1b4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:09.397124 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.397085 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:09.401912 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.401876 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:09.433928 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.433849 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:09.434126 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434113 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-web" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434128 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-web" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434136 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-metric" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434142 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-metric" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434150 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434155 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434165 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="config-reloader" Jul 09 14:59:09.434171 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434170 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="config-reloader" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434177 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51400b56-2266-425e-98e3-7b271f885a04" containerName="console" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434182 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51400b56-2266-425e-98e3-7b271f885a04" containerName="console" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434190 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="prom-label-proxy" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434195 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="prom-label-proxy" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434209 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="init-config-reloader" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434214 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="init-config-reloader" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434220 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="alertmanager" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434225 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="alertmanager" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434266 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="51400b56-2266-425e-98e3-7b271f885a04" containerName="console" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434272 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="alertmanager" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434278 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-web" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434284 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434290 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="config-reloader" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434295 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="prom-label-proxy" Jul 09 14:59:09.434361 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.434301 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" containerName="kube-rbac-proxy-metric" Jul 09 14:59:09.439416 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.439355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.442682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.442657 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:59:09.442682 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.442662 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:59:09.442893 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.442705 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:59:09.442893 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.442714 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:59:09.443185 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.443161 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:59:09.443636 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.443577 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:59:09.443894 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.443872 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:59:09.443980 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.443877 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tf5rd\"" Jul 09 14:59:09.444067 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.444058 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:59:09.449569 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.449549 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:59:09.457738 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-config-out\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457818 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457818 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457818 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457956 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457956 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-web-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457956 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.457956 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.458119 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.458119 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.457984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.458119 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.458025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.458119 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.458090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.458280 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.458136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cnl\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-kube-api-access-t4cnl\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.460608 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.460586 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:09.558708 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-web-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.558708 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cnl\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-kube-api-access-t4cnl\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559003 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.558996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-config-out\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559333 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.559958 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.559932 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.560318 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.560287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed825c2-e065-4eae-94ca-f25b9da15243-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.561748 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.561721 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ed825c2-e065-4eae-94ca-f25b9da15243-config-out\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.561861 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.561816 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.561861 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.561816 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-web-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.562018 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.561993 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.562211 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.562194 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.562282 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.562198 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.562587 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.562569 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.562758 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.562738 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.563798 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.563781 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ed825c2-e065-4eae-94ca-f25b9da15243-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.574705 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.574676 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cnl\" (UniqueName: \"kubernetes.io/projected/1ed825c2-e065-4eae-94ca-f25b9da15243-kube-api-access-t4cnl\") pod \"alertmanager-main-0\" (UID: \"1ed825c2-e065-4eae-94ca-f25b9da15243\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.751186 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.751103 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:59:09.930765 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:09.930738 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:59:09.932768 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:59:09.932743 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed825c2_e065_4eae_94ca_f25b9da15243.slice/crio-5a829d4e3d182d3dacd7ec757b7f95ecfe1b88fb4b7d7443d86e0a634b9fb7ab WatchSource:0}: Error finding container 5a829d4e3d182d3dacd7ec757b7f95ecfe1b88fb4b7d7443d86e0a634b9fb7ab: Status 404 returned error can't find the container with id 5a829d4e3d182d3dacd7ec757b7f95ecfe1b88fb4b7d7443d86e0a634b9fb7ab Jul 09 14:59:10.077259 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:10.077223 2568 generic.go:356] "Generic (PLEG): container finished" podID="1ed825c2-e065-4eae-94ca-f25b9da15243" containerID="a4fecbcb589098043ea11689e38e3c2bf399f131862761cca344d38efa8a826d" exitCode=0 Jul 09 14:59:10.077259 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:10.077262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerDied","Data":"a4fecbcb589098043ea11689e38e3c2bf399f131862761cca344d38efa8a826d"} Jul 09 14:59:10.077722 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:10.077315 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"5a829d4e3d182d3dacd7ec757b7f95ecfe1b88fb4b7d7443d86e0a634b9fb7ab"} Jul 09 14:59:10.097375 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:10.097313 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d55c71-188d-4041-bedd-6102a400c1b4" path="/var/lib/kubelet/pods/00d55c71-188d-4041-bedd-6102a400c1b4/volumes" Jul 09 14:59:11.084800 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084762 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"1e301cd0a45bae50ab2056f5e714a82d0ee64139d592e2265a11cd04645517ed"} Jul 09 14:59:11.085165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"607c6443371ff6db83d3101e0612c3a1134eac94acb64a0dc7beebc9c11158c7"} Jul 09 14:59:11.085165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"ea9953f4a4a12d23b9c706540781540a1448a5ed52ba8f8095b96b412e7e87a8"} Jul 09 14:59:11.085165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"81c0a28dc00e90386a7589b69c17bbbf573aad95a622162d4665486a9bdd9bf6"} Jul 09 14:59:11.085165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"eb90460a6a3cf522bb3fbea85fe63c04bb38c5383b2a52ac9765c2a3828752e2"} Jul 09 14:59:11.085165 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.084966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ed825c2-e065-4eae-94ca-f25b9da15243","Type":"ContainerStarted","Data":"bf5da1bdddadec3a0803c52ebde690665f49e86d98d84befca06f94960d1f559"} Jul 09 14:59:11.116689 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.116627 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.100498628 podStartE2EDuration="2.116605081s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.106453ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:11.114864636 +0000 UTC m=+217.729448493" watchObservedRunningTime="2026-07-09 14:59:11.116605081 +0000 UTC m=+217.731188937" Jul 09 14:59:11.836036 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.835994 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5777f5779d-kzxb6"] Jul 09 14:59:11.838512 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.838488 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.841487 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.841454 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 14:59:11.841669 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.841538 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jv2lc\"" Jul 09 14:59:11.841669 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.841460 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 14:59:11.842038 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.842014 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 14:59:11.842184 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.842062 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 14:59:11.842184 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.842120 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 14:59:11.847151 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.847128 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 14:59:11.860902 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.860869 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5777f5779d-kzxb6"] Jul 09 14:59:11.881688 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.881651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-serving-certs-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.881688 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.881684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882042 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.881710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882042 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.881817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzfw\" (UniqueName: \"kubernetes.io/projected/4528776b-b240-4796-b8c4-3313dd2bf3a5-kube-api-access-chzfw\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882042 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.881874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-federate-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882042 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.882009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-metrics-client-ca\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882224 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.882063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.882224 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.882093 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983359 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-metrics-client-ca\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983359 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-serving-certs-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzfw\" (UniqueName: \"kubernetes.io/projected/4528776b-b240-4796-b8c4-3313dd2bf3a5-kube-api-access-chzfw\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.983905 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.983750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-federate-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.984274 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.984214 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-metrics-client-ca\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.984604 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.984584 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.984704 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.984662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4528776b-b240-4796-b8c4-3313dd2bf3a5-serving-certs-ca-bundle\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.986360 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.986337 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.986469 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.986378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-telemeter-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.986622 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.986607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-federate-client-tls\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.986667 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.986645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4528776b-b240-4796-b8c4-3313dd2bf3a5-secret-telemeter-client\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:11.992648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:11.992631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzfw\" (UniqueName: \"kubernetes.io/projected/4528776b-b240-4796-b8c4-3313dd2bf3a5-kube-api-access-chzfw\") pod \"telemeter-client-5777f5779d-kzxb6\" (UID: \"4528776b-b240-4796-b8c4-3313dd2bf3a5\") " pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:12.150632 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:12.150534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" Jul 09 14:59:12.301568 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:12.301535 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5777f5779d-kzxb6"] Jul 09 14:59:12.305206 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:59:12.305175 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4528776b_b240_4796_b8c4_3313dd2bf3a5.slice/crio-ac053ac7b27372b5bbf5e7fbeffcff22f0e8730508fd712f825848b4866baebe WatchSource:0}: Error finding container ac053ac7b27372b5bbf5e7fbeffcff22f0e8730508fd712f825848b4866baebe: Status 404 returned error can't find the container with id ac053ac7b27372b5bbf5e7fbeffcff22f0e8730508fd712f825848b4866baebe Jul 09 14:59:13.097253 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:13.097218 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" event={"ID":"4528776b-b240-4796-b8c4-3313dd2bf3a5","Type":"ContainerStarted","Data":"ac053ac7b27372b5bbf5e7fbeffcff22f0e8730508fd712f825848b4866baebe"} Jul 09 14:59:15.108577 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.108541 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" event={"ID":"4528776b-b240-4796-b8c4-3313dd2bf3a5","Type":"ContainerStarted","Data":"731c22a5e878c4996fecc9c4fc8994b5c5037c303f706736d25a06557c9e59e4"} Jul 09 14:59:15.108983 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.108609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" event={"ID":"4528776b-b240-4796-b8c4-3313dd2bf3a5","Type":"ContainerStarted","Data":"644ef169771f5e811ac7963da1879f871c1889f03550d9d32e1a02d77001e2bd"} Jul 09 14:59:15.108983 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.108629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" event={"ID":"4528776b-b240-4796-b8c4-3313dd2bf3a5","Type":"ContainerStarted","Data":"8b0b57e96dad1e47b6ba7af33b3f0306f2c7e5ec23463554a3019fe834025fb9"} Jul 09 14:59:15.139099 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.139044 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5777f5779d-kzxb6" podStartSLOduration=1.95835699 podStartE2EDuration="4.1390234s" totalImagesPullingTime="2.18066641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:15.137460471 +0000 UTC m=+221.752044327" watchObservedRunningTime="2026-07-09 14:59:15.1390234 +0000 UTC m=+221.753607254" Jul 09 14:59:15.857196 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.857158 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 14:59:15.859784 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.859765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.875425 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.875368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 14:59:15.922717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922717 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ljv\" (UniqueName: \"kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922966 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922966 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922777 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922966 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:15.922966 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:15.922876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024102 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024102 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024104 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024323 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024126 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ljv\" (UniqueName: \"kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024323 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024152 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024323 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024171 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024323 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.024539 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.024339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.025051 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.025020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.025179 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.025159 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.025218 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.025186 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.025352 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.025335 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.026728 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.026711 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.026865 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.026848 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.033970 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.033939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ljv\" (UniqueName: \"kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv\") pod \"console-69d85d8486-zplvk\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.169314 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.169221 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:16.313845 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:16.313773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 14:59:16.316408 ip-10-0-133-241 kubenswrapper[2568]: W0709 14:59:16.316364 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09a7e0f_5a44_444d_80b6_0d0bf999baba.slice/crio-2118deb0bfce1191624bbddd9b901a7083f381db0a00db83fbca69e134b8d0c7 WatchSource:0}: Error finding container 2118deb0bfce1191624bbddd9b901a7083f381db0a00db83fbca69e134b8d0c7: Status 404 returned error can't find the container with id 2118deb0bfce1191624bbddd9b901a7083f381db0a00db83fbca69e134b8d0c7 Jul 09 14:59:17.118050 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:17.118011 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d85d8486-zplvk" event={"ID":"b09a7e0f-5a44-444d-80b6-0d0bf999baba","Type":"ContainerStarted","Data":"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e"} Jul 09 14:59:17.118240 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:17.118070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d85d8486-zplvk" event={"ID":"b09a7e0f-5a44-444d-80b6-0d0bf999baba","Type":"ContainerStarted","Data":"2118deb0bfce1191624bbddd9b901a7083f381db0a00db83fbca69e134b8d0c7"} Jul 09 14:59:17.142371 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:17.142312 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d85d8486-zplvk" podStartSLOduration=2.14229394 podStartE2EDuration="2.14229394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:17.140610177 +0000 UTC m=+223.755194035" watchObservedRunningTime="2026-07-09 14:59:17.14229394 +0000 UTC m=+223.756877795" Jul 09 14:59:26.169477 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:26.169434 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:26.169889 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:26.169507 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:26.174297 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:26.174273 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:27.163039 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:27.163004 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 14:59:27.218236 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:27.218192 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:59:52.247646 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.247602 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b6d5c8b6c-zsrhw" podUID="62499960-358d-4e1e-912f-f0f82e50e6d8" containerName="console" containerID="cri-o://832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9" gracePeriod=15 Jul 09 14:59:52.502855 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.502784 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:59:52.651433 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651369 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651433 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651429 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651490 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651551 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651579 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651681 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9gln\" (UniqueName: \"kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln\") pod \"62499960-358d-4e1e-912f-f0f82e50e6d8\" (UID: \"62499960-358d-4e1e-912f-f0f82e50e6d8\") " Jul 09 14:59:52.651944 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651901 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:52.652008 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.651986 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:52.652064 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.652024 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:52.652112 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.652052 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config" (OuterVolumeSpecName: "console-config") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:59:52.653892 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.653855 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:52.653892 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.653877 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:59:52.654037 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.653878 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln" (OuterVolumeSpecName: "kube-api-access-p9gln") pod "62499960-358d-4e1e-912f-f0f82e50e6d8" (UID: "62499960-358d-4e1e-912f-f0f82e50e6d8"). InnerVolumeSpecName "kube-api-access-p9gln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:59:52.752450 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752384 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-oauth-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752450 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752444 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752450 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752457 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-console-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752686 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752470 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752686 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752479 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62499960-358d-4e1e-912f-f0f82e50e6d8-trusted-ca-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752686 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752489 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62499960-358d-4e1e-912f-f0f82e50e6d8-console-oauth-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:52.752686 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:52.752497 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9gln\" (UniqueName: \"kubernetes.io/projected/62499960-358d-4e1e-912f-f0f82e50e6d8-kube-api-access-p9gln\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 14:59:53.262600 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.262560 2568 generic.go:356] "Generic (PLEG): container finished" podID="62499960-358d-4e1e-912f-f0f82e50e6d8" containerID="832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9" exitCode=0 Jul 09 14:59:53.263013 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.262606 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d5c8b6c-zsrhw" Jul 09 14:59:53.263013 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.262637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d5c8b6c-zsrhw" event={"ID":"62499960-358d-4e1e-912f-f0f82e50e6d8","Type":"ContainerDied","Data":"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9"} Jul 09 14:59:53.263013 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.262692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d5c8b6c-zsrhw" event={"ID":"62499960-358d-4e1e-912f-f0f82e50e6d8","Type":"ContainerDied","Data":"9e45eba7a14cb82d36028015862bca4a213f6adcda0694518fd333a192bcb73c"} Jul 09 14:59:53.263013 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.262712 2568 scope.go:117] "RemoveContainer" containerID="832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9" Jul 09 14:59:53.271697 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.271668 2568 scope.go:117] "RemoveContainer" containerID="832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9" Jul 09 14:59:53.271999 ip-10-0-133-241 kubenswrapper[2568]: E0709 14:59:53.271978 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9\": container with ID starting with 832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9 not found: ID does not exist" containerID="832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9" Jul 09 14:59:53.272074 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.272009 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9"} err="failed to get container status \"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9\": rpc error: code = NotFound desc = could not find container \"832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9\": container with ID starting with 832d3c0ceb01602d523d2663b399e88cdefdc7218123d0459c0ed5273eb800d9 not found: ID does not exist" Jul 09 14:59:53.285648 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.285622 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:59:53.289265 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:53.289238 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b6d5c8b6c-zsrhw"] Jul 09 14:59:54.097494 ip-10-0-133-241 kubenswrapper[2568]: I0709 14:59:54.097463 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62499960-358d-4e1e-912f-f0f82e50e6d8" path="/var/lib/kubelet/pods/62499960-358d-4e1e-912f-f0f82e50e6d8/volumes" Jul 09 15:00:33.872458 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:33.872429 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:00:35.251620 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.251584 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:00:35.253882 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.251893 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62499960-358d-4e1e-912f-f0f82e50e6d8" containerName="console" Jul 09 15:00:35.253882 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.251904 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62499960-358d-4e1e-912f-f0f82e50e6d8" containerName="console" Jul 09 15:00:35.253882 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.251972 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62499960-358d-4e1e-912f-f0f82e50e6d8" containerName="console" Jul 09 15:00:35.254781 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.254764 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.267794 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.267757 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:00:35.433201 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433201 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433522 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433522 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433522 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433522 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dxx\" (UniqueName: \"kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.433680 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.433537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534192 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534192 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dxx\" (UniqueName: \"kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.534435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.535001 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.534970 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.535001 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.535002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.535170 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.535081 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.535245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.535224 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.536832 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.536815 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.536895 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.536881 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.543733 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.543708 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dxx\" (UniqueName: \"kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx\") pod \"console-54c9ffdbc8-bpxpq\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.564563 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.564525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:35.703482 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:35.703357 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:00:35.706338 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:00:35.706297 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5720e0_4b25_42c6_b9ec_eaa81e73ff9c.slice/crio-f3c42ba487a84c82c3cbd693fc0e65e1667932eceeef0a17f4a1990128c84138 WatchSource:0}: Error finding container f3c42ba487a84c82c3cbd693fc0e65e1667932eceeef0a17f4a1990128c84138: Status 404 returned error can't find the container with id f3c42ba487a84c82c3cbd693fc0e65e1667932eceeef0a17f4a1990128c84138 Jul 09 15:00:36.434820 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:36.434783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9ffdbc8-bpxpq" event={"ID":"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c","Type":"ContainerStarted","Data":"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c"} Jul 09 15:00:36.435217 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:36.434835 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9ffdbc8-bpxpq" event={"ID":"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c","Type":"ContainerStarted","Data":"f3c42ba487a84c82c3cbd693fc0e65e1667932eceeef0a17f4a1990128c84138"} Jul 09 15:00:36.455741 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:36.455691 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c9ffdbc8-bpxpq" podStartSLOduration=1.455673883 podStartE2EDuration="1.455673883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:36.455177727 +0000 UTC m=+303.069761583" watchObservedRunningTime="2026-07-09 15:00:36.455673883 +0000 UTC m=+303.070257739" Jul 09 15:00:45.565516 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:45.565467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:45.565973 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:45.565586 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:45.570340 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:45.570311 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:46.479350 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:46.479320 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:00:46.540017 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:46.539982 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 15:00:57.729744 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.729706 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx"] Jul 09 15:00:57.733202 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.733182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.735907 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.735886 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 15:00:57.736968 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.736954 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 15:00:57.737022 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.736963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqt8x\"" Jul 09 15:00:57.743775 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.743752 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx"] Jul 09 15:00:57.821377 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.821316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b68q\" (UniqueName: \"kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.821377 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.821409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.821675 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.821571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.922503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.922465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.922503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.922507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b68q\" (UniqueName: \"kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.922764 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.922565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.922947 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.922924 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.923020 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.922969 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:57.932065 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:57.932037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b68q\" (UniqueName: \"kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:58.043980 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:58.043871 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:00:58.182996 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:58.182961 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx"] Jul 09 15:00:58.186172 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:00:58.186147 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ee351e_1d51_481f_b01b_c8a6c6a71b6d.slice/crio-356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5 WatchSource:0}: Error finding container 356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5: Status 404 returned error can't find the container with id 356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5 Jul 09 15:00:58.188289 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:58.188271 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:00:58.525756 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:00:58.525717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerStarted","Data":"356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5"} Jul 09 15:01:05.560589 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:05.560548 2568 generic.go:356] "Generic (PLEG): container finished" podID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerID="129ed2f348281be9c6a40be5d4c3a6e433cb12116d6055d752b696419b98fee9" exitCode=0 Jul 09 15:01:05.561062 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:05.560639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerDied","Data":"129ed2f348281be9c6a40be5d4c3a6e433cb12116d6055d752b696419b98fee9"} Jul 09 15:01:08.574675 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:08.574633 2568 generic.go:356] "Generic (PLEG): container finished" podID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerID="37c5e8153bcc1189dd202c077b2d4388a7f5dc5012050ff34de86056229fd4d1" exitCode=0 Jul 09 15:01:08.575078 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:08.574711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerDied","Data":"37c5e8153bcc1189dd202c077b2d4388a7f5dc5012050ff34de86056229fd4d1"} Jul 09 15:01:11.561917 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.561871 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d85d8486-zplvk" podUID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" containerName="console" containerID="cri-o://0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e" gracePeriod=15 Jul 09 15:01:11.833856 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.833830 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 15:01:11.955133 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955094 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955332 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955157 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955332 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955332 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955216 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955332 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955581 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955341 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84ljv\" (UniqueName: \"kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955581 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955421 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca\") pod \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\" (UID: \"b09a7e0f-5a44-444d-80b6-0d0bf999baba\") " Jul 09 15:01:11.955726 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955702 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:01:11.955783 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955695 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:01:11.955783 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955766 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config" (OuterVolumeSpecName: "console-config") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:01:11.956006 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.955985 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca" (OuterVolumeSpecName: "service-ca") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:01:11.957471 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.957440 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:01:11.957471 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.957459 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:01:11.957629 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:11.957611 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv" (OuterVolumeSpecName: "kube-api-access-84ljv") pod "b09a7e0f-5a44-444d-80b6-0d0bf999baba" (UID: "b09a7e0f-5a44-444d-80b6-0d0bf999baba"). InnerVolumeSpecName "kube-api-access-84ljv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:01:12.056794 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056751 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.056794 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056785 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84ljv\" (UniqueName: \"kubernetes.io/projected/b09a7e0f-5a44-444d-80b6-0d0bf999baba-kube-api-access-84ljv\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.056794 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056795 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.056794 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056804 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-oauth-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.057114 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056813 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-trusted-ca-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.057114 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056822 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-oauth-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.057114 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.056831 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b09a7e0f-5a44-444d-80b6-0d0bf999baba-console-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:12.594840 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.594806 2568 generic.go:356] "Generic (PLEG): container finished" podID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" containerID="0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e" exitCode=0 Jul 09 15:01:12.595292 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.594889 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d85d8486-zplvk" Jul 09 15:01:12.595292 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.594898 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d85d8486-zplvk" event={"ID":"b09a7e0f-5a44-444d-80b6-0d0bf999baba","Type":"ContainerDied","Data":"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e"} Jul 09 15:01:12.595292 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.594993 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d85d8486-zplvk" event={"ID":"b09a7e0f-5a44-444d-80b6-0d0bf999baba","Type":"ContainerDied","Data":"2118deb0bfce1191624bbddd9b901a7083f381db0a00db83fbca69e134b8d0c7"} Jul 09 15:01:12.595292 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.595022 2568 scope.go:117] "RemoveContainer" containerID="0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e" Jul 09 15:01:12.605295 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.605269 2568 scope.go:117] "RemoveContainer" containerID="0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e" Jul 09 15:01:12.605674 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:01:12.605650 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e\": container with ID starting with 0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e not found: ID does not exist" containerID="0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e" Jul 09 15:01:12.605764 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.605688 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e"} err="failed to get container status \"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e\": rpc error: code = NotFound desc = could not find container \"0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e\": container with ID starting with 0cc08335401d15e6e5a99f9dc925e422bab7a2d58ce786ef49909961ac2d741e not found: ID does not exist" Jul 09 15:01:12.616265 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.616230 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 15:01:12.630448 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:12.630417 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d85d8486-zplvk"] Jul 09 15:01:14.097987 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:14.097943 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" path="/var/lib/kubelet/pods/b09a7e0f-5a44-444d-80b6-0d0bf999baba/volumes" Jul 09 15:01:15.610408 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:15.610351 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerStarted","Data":"2cf78427550c809d07fb1be62017c79ef2ac156e0bd394807b94f243d5cb3a0e"} Jul 09 15:01:15.633143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:15.633083 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" podStartSLOduration=2.5480889319999998 podStartE2EDuration="18.63306564s" totalImagesPullingTime="16.084976708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:15.632267081 +0000 UTC m=+342.246850941" watchObservedRunningTime="2026-07-09 15:01:15.63306564 +0000 UTC m=+342.247649510" Jul 09 15:01:16.616982 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:16.616944 2568 generic.go:356] "Generic (PLEG): container finished" podID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerID="2cf78427550c809d07fb1be62017c79ef2ac156e0bd394807b94f243d5cb3a0e" exitCode=0 Jul 09 15:01:16.617489 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:16.617029 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerDied","Data":"2cf78427550c809d07fb1be62017c79ef2ac156e0bd394807b94f243d5cb3a0e"} Jul 09 15:01:17.749037 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.749011 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:01:17.913919 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.913830 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util\") pod \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " Jul 09 15:01:17.913919 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.913877 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle\") pod \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " Jul 09 15:01:17.913919 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.913916 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b68q\" (UniqueName: \"kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q\") pod \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\" (UID: \"68ee351e-1d51-481f-b01b-c8a6c6a71b6d\") " Jul 09 15:01:17.914702 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.914676 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle" (OuterVolumeSpecName: "bundle") pod "68ee351e-1d51-481f-b01b-c8a6c6a71b6d" (UID: "68ee351e-1d51-481f-b01b-c8a6c6a71b6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:01:17.916215 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.916189 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q" (OuterVolumeSpecName: "kube-api-access-7b68q") pod "68ee351e-1d51-481f-b01b-c8a6c6a71b6d" (UID: "68ee351e-1d51-481f-b01b-c8a6c6a71b6d"). InnerVolumeSpecName "kube-api-access-7b68q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:01:17.920244 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:17.920216 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util" (OuterVolumeSpecName: "util") pod "68ee351e-1d51-481f-b01b-c8a6c6a71b6d" (UID: "68ee351e-1d51-481f-b01b-c8a6c6a71b6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:01:18.015271 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.015219 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-util\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:18.015271 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.015264 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:18.015271 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.015275 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b68q\" (UniqueName: \"kubernetes.io/projected/68ee351e-1d51-481f-b01b-c8a6c6a71b6d-kube-api-access-7b68q\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:01:18.626529 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.626489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" event={"ID":"68ee351e-1d51-481f-b01b-c8a6c6a71b6d","Type":"ContainerDied","Data":"356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5"} Jul 09 15:01:18.626699 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.626540 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z2gbx" Jul 09 15:01:18.626699 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:18.626548 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="356c88f55cacc00ba592d63f6ec6afbb154d244435a97efa29a18133033603f5" Jul 09 15:01:26.004621 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004533 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd"] Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004845 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="extract" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004856 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="extract" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004866 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" containerName="console" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004872 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" containerName="console" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004887 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="pull" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004892 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="pull" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004901 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="util" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004906 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="util" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004984 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09a7e0f-5a44-444d-80b6-0d0bf999baba" containerName="console" Jul 09 15:01:26.005068 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.004990 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ee351e-1d51-481f-b01b-c8a6c6a71b6d" containerName="extract" Jul 09 15:01:26.025101 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.025065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.028349 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.028322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 15:01:26.028613 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.028559 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:01:26.028780 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.028767 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m7k8w\"" Jul 09 15:01:26.029655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.029628 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd"] Jul 09 15:01:26.083623 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.083578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b7a924-b1e7-4a3f-b63e-2829f867725b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.083817 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.083646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlmv\" (UniqueName: \"kubernetes.io/projected/49b7a924-b1e7-4a3f-b63e-2829f867725b-kube-api-access-9dlmv\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.184679 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.184644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b7a924-b1e7-4a3f-b63e-2829f867725b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.184898 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.184721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlmv\" (UniqueName: \"kubernetes.io/projected/49b7a924-b1e7-4a3f-b63e-2829f867725b-kube-api-access-9dlmv\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.185111 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.185087 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b7a924-b1e7-4a3f-b63e-2829f867725b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.194666 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.194631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlmv\" (UniqueName: \"kubernetes.io/projected/49b7a924-b1e7-4a3f-b63e-2829f867725b-kube-api-access-9dlmv\") pod \"cert-manager-operator-controller-manager-55c444bf86-b7tgd\" (UID: \"49b7a924-b1e7-4a3f-b63e-2829f867725b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.336551 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.336521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" Jul 09 15:01:26.502284 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.502258 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd"] Jul 09 15:01:26.505442 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:01:26.505413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b7a924_b1e7_4a3f_b63e_2829f867725b.slice/crio-f0b693a5d3ec4c9019d653e0b0df8651b28b5ea988f7161279bffea734232116 WatchSource:0}: Error finding container f0b693a5d3ec4c9019d653e0b0df8651b28b5ea988f7161279bffea734232116: Status 404 returned error can't find the container with id f0b693a5d3ec4c9019d653e0b0df8651b28b5ea988f7161279bffea734232116 Jul 09 15:01:26.661266 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:26.661175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" event={"ID":"49b7a924-b1e7-4a3f-b63e-2829f867725b","Type":"ContainerStarted","Data":"f0b693a5d3ec4c9019d653e0b0df8651b28b5ea988f7161279bffea734232116"} Jul 09 15:01:29.676928 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:29.676862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" event={"ID":"49b7a924-b1e7-4a3f-b63e-2829f867725b","Type":"ContainerStarted","Data":"dd59b4d8d745b7c754aa31cd1059e3a5ec8f3780abfdee3f9d79a3d44159dbef"} Jul 09 15:01:29.703972 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:29.703921 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-b7tgd" podStartSLOduration=2.52216416 podStartE2EDuration="4.703906694s" totalImagesPullingTime="2.181742534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:29.701674606 +0000 UTC m=+356.316258482" watchObservedRunningTime="2026-07-09 15:01:29.703906694 +0000 UTC m=+356.318490548" Jul 09 15:01:30.101601 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.101567 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4mqk6"] Jul 09 15:01:30.103774 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.103753 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.106341 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.106318 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 15:01:30.106551 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.106535 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kc4q5\"" Jul 09 15:01:30.106611 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.106582 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 15:01:30.122088 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.122063 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4mqk6"] Jul 09 15:01:30.217461 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.217428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.217631 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.217472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9xw\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-kube-api-access-jh9xw\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.318578 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.318544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.318759 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.318594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9xw\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-kube-api-access-jh9xw\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.344783 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.344749 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9xw\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-kube-api-access-jh9xw\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.350027 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.349997 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd976ff8-1227-4e68-8a68-a06b190b5c62-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4mqk6\" (UID: \"bd976ff8-1227-4e68-8a68-a06b190b5c62\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.427588 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.427502 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:30.567099 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.567073 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4mqk6"] Jul 09 15:01:30.569228 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:01:30.569201 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd976ff8_1227_4e68_8a68_a06b190b5c62.slice/crio-1342b0e36493828b61abd674cec8d8b594d767fadc089802db9c58f9292ceba9 WatchSource:0}: Error finding container 1342b0e36493828b61abd674cec8d8b594d767fadc089802db9c58f9292ceba9: Status 404 returned error can't find the container with id 1342b0e36493828b61abd674cec8d8b594d767fadc089802db9c58f9292ceba9 Jul 09 15:01:30.681744 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:30.681661 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" event={"ID":"bd976ff8-1227-4e68-8a68-a06b190b5c62","Type":"ContainerStarted","Data":"1342b0e36493828b61abd674cec8d8b594d767fadc089802db9c58f9292ceba9"} Jul 09 15:01:33.698622 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:33.698586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" event={"ID":"bd976ff8-1227-4e68-8a68-a06b190b5c62","Type":"ContainerStarted","Data":"8a5ae0fbc1354e8f66a2ac9beec2fda84a2f61e6f5f6d5088288771e4e3ef555"} Jul 09 15:01:33.699017 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:33.698648 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:33.721707 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:33.721661 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" podStartSLOduration=0.70261821 podStartE2EDuration="3.721645184s" totalImagesPullingTime="3.019026974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:33.719507582 +0000 UTC m=+360.334091462" watchObservedRunningTime="2026-07-09 15:01:33.721645184 +0000 UTC m=+360.336229039" Jul 09 15:01:39.705775 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:39.705736 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4mqk6" Jul 09 15:01:50.071950 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.071916 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xwxrg"] Jul 09 15:01:50.074760 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.074739 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.077708 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.077684 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hsvpt\"" Jul 09 15:01:50.088866 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.088845 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xwxrg"] Jul 09 15:01:50.188328 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.188302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2rsf\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-kube-api-access-z2rsf\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.188473 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.188364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-bound-sa-token\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.289222 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.289194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-bound-sa-token\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.289370 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.289243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2rsf\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-kube-api-access-z2rsf\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.299585 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.299565 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-bound-sa-token\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.299676 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.299607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2rsf\" (UniqueName: \"kubernetes.io/projected/eabd6719-337b-4444-a18f-eede31bc78e9-kube-api-access-z2rsf\") pod \"cert-manager-55b4d954d5-xwxrg\" (UID: \"eabd6719-337b-4444-a18f-eede31bc78e9\") " pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.383347 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.383272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xwxrg" Jul 09 15:01:50.510580 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.510551 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xwxrg"] Jul 09 15:01:50.513660 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:01:50.513632 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeabd6719_337b_4444_a18f_eede31bc78e9.slice/crio-2f46c28e366ad093861a8899eafe29c0068d7a3626e3318e1d617c04aada3287 WatchSource:0}: Error finding container 2f46c28e366ad093861a8899eafe29c0068d7a3626e3318e1d617c04aada3287: Status 404 returned error can't find the container with id 2f46c28e366ad093861a8899eafe29c0068d7a3626e3318e1d617c04aada3287 Jul 09 15:01:50.778363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.778278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xwxrg" event={"ID":"eabd6719-337b-4444-a18f-eede31bc78e9","Type":"ContainerStarted","Data":"8d17ca856722721618ad12a1f28558dd4bd6dc8a31940c75e4c200c5b6a3149a"} Jul 09 15:01:50.778363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.778326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xwxrg" event={"ID":"eabd6719-337b-4444-a18f-eede31bc78e9","Type":"ContainerStarted","Data":"2f46c28e366ad093861a8899eafe29c0068d7a3626e3318e1d617c04aada3287"} Jul 09 15:01:50.799261 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:01:50.799215 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xwxrg" podStartSLOduration=0.799200054 podStartE2EDuration="799.200054ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:50.797511178 +0000 UTC m=+377.412095034" watchObservedRunningTime="2026-07-09 15:01:50.799200054 +0000 UTC m=+377.413783909" Jul 09 15:02:20.465347 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.465314 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx"] Jul 09 15:02:20.468227 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.468212 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.470982 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.470963 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 15:02:20.471100 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.470966 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 15:02:20.472132 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.472117 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lqt8x\"" Jul 09 15:02:20.480502 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.480476 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx"] Jul 09 15:02:20.538298 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.538277 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkqqp\" (UniqueName: \"kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.538451 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.538324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.538527 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.538471 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.639094 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.639071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.639224 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.639104 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkqqp\" (UniqueName: \"kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.639224 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.639153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.639499 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.639476 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.639574 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.639525 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.649061 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.649035 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkqqp\" (UniqueName: \"kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.777930 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.777864 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:20.915045 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:20.915020 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx"] Jul 09 15:02:20.917302 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:02:20.917268 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214277a4_7b1b_4ca2_bb72_f8cfdc7e063a.slice/crio-ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929 WatchSource:0}: Error finding container ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929: Status 404 returned error can't find the container with id ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929 Jul 09 15:02:21.909361 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:21.909264 2568 generic.go:356] "Generic (PLEG): container finished" podID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerID="2d4107c6ed07eef38ed8729e3e3ea2df4559650c22d4eb1eb693a78552b27e51" exitCode=0 Jul 09 15:02:21.909771 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:21.909360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" event={"ID":"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a","Type":"ContainerDied","Data":"2d4107c6ed07eef38ed8729e3e3ea2df4559650c22d4eb1eb693a78552b27e51"} Jul 09 15:02:21.909771 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:21.909476 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" event={"ID":"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a","Type":"ContainerStarted","Data":"ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929"} Jul 09 15:02:22.915280 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:22.915244 2568 generic.go:356] "Generic (PLEG): container finished" podID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerID="8f32c617060df22f54cb53be343752494d15a5ccaf9e1249fc2fca5bee5df398" exitCode=0 Jul 09 15:02:22.915644 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:22.915334 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" event={"ID":"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a","Type":"ContainerDied","Data":"8f32c617060df22f54cb53be343752494d15a5ccaf9e1249fc2fca5bee5df398"} Jul 09 15:02:23.922929 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:23.922901 2568 generic.go:356] "Generic (PLEG): container finished" podID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerID="f4eff67a7883186c65dcfc7dce5742154ab18ad81a2a8c95b97bf7e9f8a70df6" exitCode=0 Jul 09 15:02:23.923348 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:23.922986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" event={"ID":"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a","Type":"ContainerDied","Data":"f4eff67a7883186c65dcfc7dce5742154ab18ad81a2a8c95b97bf7e9f8a70df6"} Jul 09 15:02:24.696382 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.696338 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp"] Jul 09 15:02:24.698441 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.698424 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.702442 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702418 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 15:02:24.702570 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702416 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:02:24.702570 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 15:02:24.702570 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702503 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 15:02:24.702570 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702426 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 15:02:24.702774 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.702452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gqtlg\"" Jul 09 15:02:24.709500 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.709478 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp"] Jul 09 15:02:24.776499 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.776472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8tsj\" (UniqueName: \"kubernetes.io/projected/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-kube-api-access-l8tsj\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.776631 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.776516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-manager-config\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.776631 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.776541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.776631 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.776589 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-metrics-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.877188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.877163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.877337 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.877215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-metrics-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.877337 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.877247 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8tsj\" (UniqueName: \"kubernetes.io/projected/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-kube-api-access-l8tsj\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.877337 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.877279 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-manager-config\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.877995 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.877972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-manager-config\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.879642 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.879616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.879725 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.879663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-metrics-cert\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:24.887107 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:24.887082 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8tsj\" (UniqueName: \"kubernetes.io/projected/dc13f2f6-e2e8-4668-bf80-5e1d573f65f7-kube-api-access-l8tsj\") pod \"lws-controller-manager-79ccf9794-8m8sp\" (UID: \"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:25.007559 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.007529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:25.051247 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.051224 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:25.081799 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.079292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util\") pod \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " Jul 09 15:02:25.081799 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.079337 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle\") pod \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " Jul 09 15:02:25.081799 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.079815 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkqqp\" (UniqueName: \"kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp\") pod \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\" (UID: \"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a\") " Jul 09 15:02:25.083673 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.083648 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle" (OuterVolumeSpecName: "bundle") pod "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" (UID: "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:02:25.086098 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.086064 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp" (OuterVolumeSpecName: "kube-api-access-kkqqp") pod "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" (UID: "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a"). InnerVolumeSpecName "kube-api-access-kkqqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:02:25.090577 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.090559 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util" (OuterVolumeSpecName: "util") pod "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" (UID: "214277a4-7b1b-4ca2-bb72-f8cfdc7e063a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:02:25.161725 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.161700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp"] Jul 09 15:02:25.163468 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:02:25.163445 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc13f2f6_e2e8_4668_bf80_5e1d573f65f7.slice/crio-0961de674531e904657cfd4d00d0d5be26edff8ba52f177a3681ae4e541d8513 WatchSource:0}: Error finding container 0961de674531e904657cfd4d00d0d5be26edff8ba52f177a3681ae4e541d8513: Status 404 returned error can't find the container with id 0961de674531e904657cfd4d00d0d5be26edff8ba52f177a3681ae4e541d8513 Jul 09 15:02:25.180568 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.180543 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-util\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:02:25.180568 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.180569 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:02:25.180693 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.180583 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkqqp\" (UniqueName: \"kubernetes.io/projected/214277a4-7b1b-4ca2-bb72-f8cfdc7e063a-kube-api-access-kkqqp\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:02:25.933646 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.933622 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" Jul 09 15:02:25.933646 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.933634 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afg46vx" event={"ID":"214277a4-7b1b-4ca2-bb72-f8cfdc7e063a","Type":"ContainerDied","Data":"ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929"} Jul 09 15:02:25.933834 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.933687 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad1ed17d65b968ea725a90d0d42ff089b33974729d4129159a7b681c25b76929" Jul 09 15:02:25.934891 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:25.934868 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" event={"ID":"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7","Type":"ContainerStarted","Data":"0961de674531e904657cfd4d00d0d5be26edff8ba52f177a3681ae4e541d8513"} Jul 09 15:02:27.945922 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:27.945884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" event={"ID":"dc13f2f6-e2e8-4668-bf80-5e1d573f65f7","Type":"ContainerStarted","Data":"7577c4fdc9421b8fd9fbb6ca263d33e4c871081eb66c816faac6c571818995f0"} Jul 09 15:02:27.946271 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:27.945990 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:27.968256 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:27.968208 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" podStartSLOduration=1.413611648 podStartE2EDuration="3.9681949s" totalImagesPullingTime="2.554583252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:27.966787434 +0000 UTC m=+414.581371311" watchObservedRunningTime="2026-07-09 15:02:27.9681949 +0000 UTC m=+414.582778755" Jul 09 15:02:38.790264 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790228 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m"] Jul 09 15:02:38.790645 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790589 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="extract" Jul 09 15:02:38.790645 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790605 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="extract" Jul 09 15:02:38.790645 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790626 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="pull" Jul 09 15:02:38.790645 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790634 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="pull" Jul 09 15:02:38.790779 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790647 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="util" Jul 09 15:02:38.790779 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790655 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="util" Jul 09 15:02:38.790779 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.790741 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="214277a4-7b1b-4ca2-bb72-f8cfdc7e063a" containerName="extract" Jul 09 15:02:38.792811 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.792793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.796459 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.796437 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 15:02:38.796593 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.796538 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-28fml\"" Jul 09 15:02:38.796653 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.796634 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 15:02:38.797055 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.797034 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 15:02:38.797946 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.797926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 15:02:38.819181 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.819162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m"] Jul 09 15:02:38.893007 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.892976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.893171 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.893014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.893171 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.893125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.893171 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.893159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhn72\" (UniqueName: \"kubernetes.io/projected/d3169823-b2f9-4677-bf0e-54f69628a01f-kube-api-access-bhn72\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.893341 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.893192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.953080 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.953056 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-8m8sp" Jul 09 15:02:38.993690 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.993566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.993690 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.993603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhn72\" (UniqueName: \"kubernetes.io/projected/d3169823-b2f9-4677-bf0e-54f69628a01f-kube-api-access-bhn72\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.993690 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.993660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.994197 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.993936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.994197 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.994010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.994197 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.994071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.996676 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.996648 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.996948 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.996925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3169823-b2f9-4677-bf0e-54f69628a01f-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:38.997053 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:38.996971 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3169823-b2f9-4677-bf0e-54f69628a01f-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:39.010644 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:39.010618 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhn72\" (UniqueName: \"kubernetes.io/projected/d3169823-b2f9-4677-bf0e-54f69628a01f-kube-api-access-bhn72\") pod \"opendatahub-operator-controller-manager-69d458487d-6bb2m\" (UID: \"d3169823-b2f9-4677-bf0e-54f69628a01f\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:39.103588 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:39.103563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:39.246673 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:39.246646 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m"] Jul 09 15:02:39.249371 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:02:39.249342 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3169823_b2f9_4677_bf0e_54f69628a01f.slice/crio-9ea57372699f7b9e4572355e146169866f5e4b50459931497e7c10145e8cf5b4 WatchSource:0}: Error finding container 9ea57372699f7b9e4572355e146169866f5e4b50459931497e7c10145e8cf5b4: Status 404 returned error can't find the container with id 9ea57372699f7b9e4572355e146169866f5e4b50459931497e7c10145e8cf5b4 Jul 09 15:02:40.006314 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:40.006273 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" event={"ID":"d3169823-b2f9-4677-bf0e-54f69628a01f","Type":"ContainerStarted","Data":"9ea57372699f7b9e4572355e146169866f5e4b50459931497e7c10145e8cf5b4"} Jul 09 15:02:43.023659 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:43.023611 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" event={"ID":"d3169823-b2f9-4677-bf0e-54f69628a01f","Type":"ContainerStarted","Data":"36293bd4314682d60ef28b42f69feac3e303e35c68d0e9c719967bc48b7200fc"} Jul 09 15:02:44.028664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:44.028631 2568 generic.go:356] "Generic (PLEG): container finished" podID="d3169823-b2f9-4677-bf0e-54f69628a01f" containerID="36293bd4314682d60ef28b42f69feac3e303e35c68d0e9c719967bc48b7200fc" exitCode=0 Jul 09 15:02:44.029169 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:44.028713 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" event={"ID":"d3169823-b2f9-4677-bf0e-54f69628a01f","Type":"ContainerDied","Data":"36293bd4314682d60ef28b42f69feac3e303e35c68d0e9c719967bc48b7200fc"} Jul 09 15:02:47.044204 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:47.044155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" event={"ID":"d3169823-b2f9-4677-bf0e-54f69628a01f","Type":"ContainerStarted","Data":"53c83a218ca3b614d7e6b94c388c57568239fecedfd9e7eb727d7b0b5c901985"} Jul 09 15:02:47.044674 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:47.044302 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:02:47.104536 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:47.104478 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" podStartSLOduration=2.880421877 podStartE2EDuration="9.104462271s" totalImagesPullingTime="5.188747913s" totalInitContainerRuntime="1.035292481s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:47.103761967 +0000 UTC m=+433.718345823" watchObservedRunningTime="2026-07-09 15:02:47.104462271 +0000 UTC m=+433.719046126" Jul 09 15:02:58.050589 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:02:58.050513 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-6bb2m" Jul 09 15:03:08.454643 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.454608 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj"] Jul 09 15:03:08.463031 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.463003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.471300 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.471278 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 15:03:08.471665 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.471653 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 15:03:08.472077 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.472059 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 15:03:08.472160 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.472130 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgt28\"" Jul 09 15:03:08.472756 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.472742 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 15:03:08.479501 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.479482 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj"] Jul 09 15:03:08.551484 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lrq\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-kube-api-access-s4lrq\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551655 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.551832 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.551731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653113 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653307 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lrq\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-kube-api-access-s4lrq\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653307 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653307 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653307 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653562 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.653562 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.653460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.654209 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.654181 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.655735 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.655710 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.655844 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.655813 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.655999 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.655980 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.656062 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.656021 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.667215 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.667191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.669859 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.669833 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lrq\" (UniqueName: \"kubernetes.io/projected/5ef56fcc-a680-4d3e-84e4-2bcda372e1c4-kube-api-access-s4lrq\") pod \"istiod-openshift-gateway-94bb8fbfd-hwlrj\" (UID: \"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.771801 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.771711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:08.955620 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:08.955573 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj"] Jul 09 15:03:08.958161 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:03:08.958133 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef56fcc_a680_4d3e_84e4_2bcda372e1c4.slice/crio-9d53d2656ee6f4e73fd2241dedf74c510fa0f13f2e5f7fd0fc26437233e7cfa9 WatchSource:0}: Error finding container 9d53d2656ee6f4e73fd2241dedf74c510fa0f13f2e5f7fd0fc26437233e7cfa9: Status 404 returned error can't find the container with id 9d53d2656ee6f4e73fd2241dedf74c510fa0f13f2e5f7fd0fc26437233e7cfa9 Jul 09 15:03:09.147147 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:09.147119 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" event={"ID":"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4","Type":"ContainerStarted","Data":"9d53d2656ee6f4e73fd2241dedf74c510fa0f13f2e5f7fd0fc26437233e7cfa9"} Jul 09 15:03:11.581587 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:11.581553 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:03:11.581833 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:11.581617 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:03:12.168590 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:12.168536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" event={"ID":"5ef56fcc-a680-4d3e-84e4-2bcda372e1c4","Type":"ContainerStarted","Data":"0b7bbc03e62d9ee1351cd6846b6d2de56b3743ef2ab24510a272edd2a61bab89"} Jul 09 15:03:12.169904 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:12.169879 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:03:12.171763 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:12.171723 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hwlrj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:03:12.171883 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:12.171798 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" podUID="5ef56fcc-a680-4d3e-84e4-2bcda372e1c4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:03:12.201411 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:12.201328 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" podStartSLOduration=1.58071339 podStartE2EDuration="4.201305998s" totalImagesPullingTime="2.620592608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:12.199875301 +0000 UTC m=+458.814459157" watchObservedRunningTime="2026-07-09 15:03:12.201305998 +0000 UTC m=+458.815889856" Jul 09 15:03:13.174208 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:03:13.174178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hwlrj" Jul 09 15:04:36.260483 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:04:36.260408 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:05:01.282296 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.282257 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54c9ffdbc8-bpxpq" podUID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" containerName="console" containerID="cri-o://b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c" gracePeriod=15 Jul 09 15:05:01.530181 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.530156 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:05:01.658904 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.658868 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6dxx\" (UniqueName: \"kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.658904 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.658906 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659121 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659038 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659121 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659079 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659205 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659137 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659205 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659174 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659310 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659210 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config\") pod \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\" (UID: \"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c\") " Jul 09 15:05:01.659367 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659330 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:05:01.659718 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659557 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config" (OuterVolumeSpecName: "console-config") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:05:01.659718 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659619 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:05:01.659718 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659625 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:05:01.659935 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659740 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.659935 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659760 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-trusted-ca-bundle\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.659935 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659774 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-service-ca\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.659935 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.659911 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-oauth-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.661366 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.661337 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx" (OuterVolumeSpecName: "kube-api-access-b6dxx") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "kube-api-access-b6dxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:05:01.661549 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.661527 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:05:01.661549 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.661543 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" (UID: "9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:05:01.683056 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.683023 2568 generic.go:356] "Generic (PLEG): container finished" podID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" containerID="b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c" exitCode=0 Jul 09 15:05:01.683186 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.683070 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9ffdbc8-bpxpq" Jul 09 15:05:01.683186 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.683101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9ffdbc8-bpxpq" event={"ID":"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c","Type":"ContainerDied","Data":"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c"} Jul 09 15:05:01.683186 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.683149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9ffdbc8-bpxpq" event={"ID":"9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c","Type":"ContainerDied","Data":"f3c42ba487a84c82c3cbd693fc0e65e1667932eceeef0a17f4a1990128c84138"} Jul 09 15:05:01.683186 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.683168 2568 scope.go:117] "RemoveContainer" containerID="b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c" Jul 09 15:05:01.692509 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.692466 2568 scope.go:117] "RemoveContainer" containerID="b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c" Jul 09 15:05:01.692735 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:05:01.692720 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c\": container with ID starting with b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c not found: ID does not exist" containerID="b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c" Jul 09 15:05:01.692776 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.692744 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c"} err="failed to get container status \"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c\": rpc error: code = NotFound desc = could not find container \"b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c\": container with ID starting with b1690838c289b3d0cb024a5528314117067ec3e329f5e2e376498298034bb95c not found: ID does not exist" Jul 09 15:05:01.713993 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.710937 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:05:01.716631 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.716606 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c9ffdbc8-bpxpq"] Jul 09 15:05:01.760363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.760329 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-oauth-config\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.760363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.760363 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6dxx\" (UniqueName: \"kubernetes.io/projected/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-kube-api-access-b6dxx\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:01.760540 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:01.760374 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c-console-serving-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:05:02.097467 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:02.097436 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" path="/var/lib/kubelet/pods/9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c/volumes" Jul 09 15:05:31.396904 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.396869 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:05:31.397363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.397194 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" containerName="console" Jul 09 15:05:31.397363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.397205 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" containerName="console" Jul 09 15:05:31.397363 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.397289 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5720e0-4b25-42c6-b9ec-eaa81e73ff9c" containerName="console" Jul 09 15:05:31.399574 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.399556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.402575 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.402554 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 15:05:31.402722 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.402595 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 15:05:31.402791 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.402775 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 15:05:31.403645 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.403624 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rm8lj\"" Jul 09 15:05:31.411465 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.411442 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:05:31.457780 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.457748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:05:31.521679 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.521650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mds\" (UniqueName: \"kubernetes.io/projected/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-kube-api-access-f4mds\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.521831 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.521684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-config-file\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.623031 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.622992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mds\" (UniqueName: \"kubernetes.io/projected/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-kube-api-access-f4mds\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.623031 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.623037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-config-file\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.623748 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.623728 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-config-file\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.633088 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.633060 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mds\" (UniqueName: \"kubernetes.io/projected/30e7d694-5b3f-41dc-8a9f-7caf81b64a16-kube-api-access-f4mds\") pod \"limitador-limitador-54d6d988d5-btmpm\" (UID: \"30e7d694-5b3f-41dc-8a9f-7caf81b64a16\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.709746 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.709662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:31.843599 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:31.843575 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:05:31.845804 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:05:31.845774 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e7d694_5b3f_41dc_8a9f_7caf81b64a16.slice/crio-6674cb1cce7526d3fdb80a4c50020478d16006ea0d55be7b393efe044632cf66 WatchSource:0}: Error finding container 6674cb1cce7526d3fdb80a4c50020478d16006ea0d55be7b393efe044632cf66: Status 404 returned error can't find the container with id 6674cb1cce7526d3fdb80a4c50020478d16006ea0d55be7b393efe044632cf66 Jul 09 15:05:32.827026 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:32.826992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" event={"ID":"30e7d694-5b3f-41dc-8a9f-7caf81b64a16","Type":"ContainerStarted","Data":"6674cb1cce7526d3fdb80a4c50020478d16006ea0d55be7b393efe044632cf66"} Jul 09 15:05:39.868448 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:39.868384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" event={"ID":"30e7d694-5b3f-41dc-8a9f-7caf81b64a16","Type":"ContainerStarted","Data":"dde17c65f8996b07dd7ea9203ef89dce3a84386b30336e6e43a2ad6dc006adee"} Jul 09 15:05:39.868846 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:39.868543 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:05:39.888573 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:39.888529 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" podStartSLOduration=1.612021774 podStartE2EDuration="8.888515314s" totalImagesPullingTime="7.27649354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:39.887295782 +0000 UTC m=+606.501879637" watchObservedRunningTime="2026-07-09 15:05:39.888515314 +0000 UTC m=+606.503099179" Jul 09 15:05:50.877241 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:05:50.877209 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-btmpm" Jul 09 15:06:46.607288 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:06:46.607249 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:07:04.804541 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:04.804508 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:07:13.971014 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:13.970976 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:07:25.666910 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:25.666820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:07:35.381340 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:35.381303 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:07:50.672036 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.672002 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7"] Jul 09 15:07:50.674757 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.674732 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.677696 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.677675 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 15:07:50.678774 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.678749 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 15:07:50.678901 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.678841 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x5qqk\"" Jul 09 15:07:50.678965 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.678846 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 15:07:50.686178 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.686159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7"] Jul 09 15:07:50.850561 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.850761 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63af90ed-3831-4380-91bc-a0aee5d64c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.850761 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969jk\" (UniqueName: \"kubernetes.io/projected/63af90ed-3831-4380-91bc-a0aee5d64c31-kube-api-access-969jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.850761 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.850761 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.850761 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.850729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951424 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951424 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63af90ed-3831-4380-91bc-a0aee5d64c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951424 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969jk\" (UniqueName: \"kubernetes.io/projected/63af90ed-3831-4380-91bc-a0aee5d64c31-kube-api-access-969jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951706 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951706 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951706 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951855 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951895 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951844 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.951941 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.951922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.953828 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.953809 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63af90ed-3831-4380-91bc-a0aee5d64c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.960278 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.954469 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63af90ed-3831-4380-91bc-a0aee5d64c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.961667 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.961646 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-969jk\" (UniqueName: \"kubernetes.io/projected/63af90ed-3831-4380-91bc-a0aee5d64c31-kube-api-access-969jk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rkvn7\" (UID: \"63af90ed-3831-4380-91bc-a0aee5d64c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:50.986944 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:50.986908 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:07:51.120895 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:51.120863 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7"] Jul 09 15:07:51.123881 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:07:51.123853 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63af90ed_3831_4380_91bc_a0aee5d64c31.slice/crio-0602dd9005ae9ca0523071ff8a5e2b3f3f54f72ff7e2f046cb74b638dd3be586 WatchSource:0}: Error finding container 0602dd9005ae9ca0523071ff8a5e2b3f3f54f72ff7e2f046cb74b638dd3be586: Status 404 returned error can't find the container with id 0602dd9005ae9ca0523071ff8a5e2b3f3f54f72ff7e2f046cb74b638dd3be586 Jul 09 15:07:51.125055 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:51.125034 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:07:51.486212 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:51.486180 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" event={"ID":"63af90ed-3831-4380-91bc-a0aee5d64c31","Type":"ContainerStarted","Data":"0602dd9005ae9ca0523071ff8a5e2b3f3f54f72ff7e2f046cb74b638dd3be586"} Jul 09 15:07:52.492703 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:52.492670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" event={"ID":"63af90ed-3831-4380-91bc-a0aee5d64c31","Type":"ContainerStarted","Data":"2d99ce50d970ccd9eb3a26eeda77cf6adfee56645444341299da9caa41177d55"} Jul 09 15:07:52.517659 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:52.517601 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" podStartSLOduration=1.3450442 podStartE2EDuration="2.517581676s" totalImagesPullingTime="1.172537476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:07:52.515780772 +0000 UTC m=+739.130364628" watchObservedRunningTime="2026-07-09 15:07:52.517581676 +0000 UTC m=+739.132165531" Jul 09 15:07:52.864578 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:07:52.864546 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:08:00.987484 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:08:00.987448 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:08:00.987952 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:08:00.987504 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:08:01.000117 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:08:01.000096 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:08:01.546640 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:08:01.546613 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rkvn7" Jul 09 15:08:03.581867 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:08:03.581836 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:09:28.476487 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:09:28.476451 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:09:39.673039 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:09:39.673005 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:09:50.476963 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:09:50.476931 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:09:59.364589 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:09:59.364556 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:10:09.974174 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:10:09.974143 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:10:38.774427 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:10:38.774366 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:10:51.474425 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:10:51.474378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:11:24.567316 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:11:24.567273 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:11:34.371875 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:11:34.371839 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:11:42.874561 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:11:42.874528 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:11:52.073437 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:11:52.073405 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:12:01.271048 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:12:01.270971 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:12:12.624279 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:12:12.624237 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:12:23.883121 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:12:23.883088 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:12:33.873218 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:12:33.873182 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:12:59.173790 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:12:59.173759 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:13:10.882135 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:13:10.882103 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:13:33.872774 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:13:33.872702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:13:43.362895 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:13:43.362862 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:14:01.073766 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:14:01.073729 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:14:12.774656 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:14:12.774623 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:14:22.272601 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:14:22.272563 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:14:31.665974 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:14:31.665937 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:14:41.272423 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:14:41.272375 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:16:29.284781 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:16:29.284741 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:16:41.482475 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:16:41.482442 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:16:49.782065 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:16:49.782032 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:01.968999 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:01.968966 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:13.562884 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:13.562848 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:24.677522 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:24.677488 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:33.272674 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:33.272635 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:43.579279 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:43.579241 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:17:55.371900 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:17:55.371828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:18:04.374589 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:18:04.374552 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:18:14.976975 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:18:14.976940 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:18:39.820606 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:18:39.820574 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:18:47.805568 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:18:47.805532 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:18:57.591673 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:18:57.591631 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:19:05.490191 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:19:05.490150 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:19:19.308261 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:19:19.308225 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:19:32.684271 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:19:32.684201 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:19:47.582714 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:19:47.582680 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:19:56.581787 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:19:56.581757 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:20:09.886738 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:20:09.886707 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:20:18.983572 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:20:18.983538 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:20:32.484127 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:20:32.484089 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:20:42.288587 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:20:42.288548 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:20:52.683007 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:20:52.682975 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:05.479542 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:05.479454 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:17.079174 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:17.079133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:25.179828 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:25.179788 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:37.072406 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:37.072359 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:48.575872 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:48.575828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:21:59.981767 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:21:59.981716 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:22:17.474707 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:22:17.474616 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:22:30.473144 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:22:30.473105 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:22:42.267818 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:22:42.267781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:22:50.078018 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:22:50.077969 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:23:01.481233 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:23:01.481191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:24:22.078689 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:24:22.078599 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:24:29.980188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:24:29.980145 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:24:37.573332 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:24:37.573290 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:24:45.580359 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:24:45.580303 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:24:56.478283 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:24:56.478239 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:25:29.169125 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:25:29.169026 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:25:39.281568 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:25:39.281534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:25:55.094156 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:25:55.094109 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:26:05.679466 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:26:05.679428 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:26:15.670315 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:26:15.670275 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:26:52.366731 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:26:52.366695 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:27:01.795789 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:27:01.795700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:27:15.874909 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:27:15.874866 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:28:05.207940 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:28:05.207888 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:28:20.176908 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:28:20.176870 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:28:37.368031 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:28:37.367944 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:28:51.771083 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:28:51.771049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:29:06.465322 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:06.465269 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:29:41.773153 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:41.773115 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:29:46.272003 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.271965 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:29:46.275369 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.275347 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.278639 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.278595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-88802e-openshift-default-dockercfg-ckwvv\"" Jul 09 15:29:46.291333 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.291293 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:29:46.353482 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353429 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353482 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2q2w\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353715 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353589 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353715 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353715 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353827 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353827 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353827 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.353934 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.353883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454338 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454338 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454605 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454605 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454442 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454605 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2q2w\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454605 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454498 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454605 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454847 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454847 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.454847 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.454800 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.455090 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.455067 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.455290 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.455152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.455377 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.455182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.455377 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.455331 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.457040 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.457013 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.457138 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.457118 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.464435 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.464412 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2q2w\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.464553 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.464493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token\") pod \"e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.594202 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.594173 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:46.745521 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.745476 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:29:46.747982 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:29:46.747952 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe7c3d8_be26_42ed_986d_51bf9dd70c93.slice/crio-780634a072fea1c7c6d1c5c0eee0a9edd5ade2fcb2a1b2e4459f8ee50ac058f2 WatchSource:0}: Error finding container 780634a072fea1c7c6d1c5c0eee0a9edd5ade2fcb2a1b2e4459f8ee50ac058f2: Status 404 returned error can't find the container with id 780634a072fea1c7c6d1c5c0eee0a9edd5ade2fcb2a1b2e4459f8ee50ac058f2 Jul 09 15:29:46.749901 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.749883 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:29:46.759852 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:46.759819 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerStarted","Data":"780634a072fea1c7c6d1c5c0eee0a9edd5ade2fcb2a1b2e4459f8ee50ac058f2"} Jul 09 15:29:49.493684 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:49.493645 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:29:49.493967 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:49.493720 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:29:49.493967 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:49.493747 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:29:49.778257 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:49.778153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerStarted","Data":"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1"} Jul 09 15:29:49.806301 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:49.806223 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podStartSLOduration=1.062901265 podStartE2EDuration="3.806197411s" totalImagesPullingTime="2.743296146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:49.802920766 +0000 UTC m=+2056.417504649" watchObservedRunningTime="2026-07-09 15:29:49.806197411 +0000 UTC m=+2056.420781267" Jul 09 15:29:50.595023 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:50.594975 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:50.600180 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:50.600154 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:50.783137 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:50.783109 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:50.784189 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:50.784163 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:29:55.275377 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:29:55.275281 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:30:03.853767 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.853732 2568 generic.go:356] "Generic (PLEG): container finished" podID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerID="8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1" exitCode=0 Jul 09 15:30:03.854217 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.853803 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerDied","Data":"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1"} Jul 09 15:30:03.854267 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.854216 2568 scope.go:117] "RemoveContainer" containerID="8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1" Jul 09 15:30:03.856294 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.856263 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:03.856423 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.856350 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:03.856423 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:03.856409 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:04.862264 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:04.862214 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerStarted","Data":"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf"} Jul 09 15:30:05.595161 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:05.595118 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:05.596462 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:05.596419 2568 patch_prober.go:28] interesting pod/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:05.596589 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:05.596519 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:05.783868 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:05.783824 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:06.594786 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:06.594742 2568 patch_prober.go:28] interesting pod/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:06.595215 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:06.594806 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:07.595614 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:07.595571 2568 patch_prober.go:28] interesting pod/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:07.596041 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:07.595636 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:08.379370 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:08.379325 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:30:08.594820 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:08.594774 2568 patch_prober.go:28] interesting pod/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:08.595013 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:08.594841 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:09.599213 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:09.599178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:09.600353 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:09.600329 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:21.190587 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:21.190548 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:30:21.191111 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:21.190773 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" containerID="cri-o://4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf" gracePeriod=30 Jul 09 15:30:24.602595 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:24.602556 2568 patch_prober.go:28] interesting pod/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:30:24.603002 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:24.602623 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:26.182818 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.182774 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:30:26.462317 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.462285 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:26.542174 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542140 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542374 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542239 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542374 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542284 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542374 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542320 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542374 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542342 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542379 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542437 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542465 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542494 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2q2w\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w\") pod \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\" (UID: \"abe7c3d8-be26-42ed-986d-51bf9dd70c93\") " Jul 09 15:30:26.542610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542555 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:26.542843 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542766 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:26.542843 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542779 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:26.542843 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542795 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.542983 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.542881 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:30:26.543099 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.543071 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data" (OuterVolumeSpecName: "istio-data") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:26.544839 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.544811 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:30:26.544960 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.544842 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:26.544960 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.544859 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w" (OuterVolumeSpecName: "kube-api-access-s2q2w") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "kube-api-access-s2q2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:30:26.544960 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.544909 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token" (OuterVolumeSpecName: "istio-token") pod "abe7c3d8-be26-42ed-986d-51bf9dd70c93" (UID: "abe7c3d8-be26-42ed-986d-51bf9dd70c93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:30:26.644044 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.643997 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-podinfo\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644044 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644034 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istiod-ca-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644044 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644043 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-token\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644044 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644053 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-credential-socket\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644044 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644062 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-envoy\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644359 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644071 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-workload-socket\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644359 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644079 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2q2w\" (UniqueName: \"kubernetes.io/projected/abe7c3d8-be26-42ed-986d-51bf9dd70c93-kube-api-access-s2q2w\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.644359 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.644089 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe7c3d8-be26-42ed-986d-51bf9dd70c93-istio-data\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:30:26.978455 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.978422 2568 generic.go:356] "Generic (PLEG): container finished" podID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerID="4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf" exitCode=0 Jul 09 15:30:26.978664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.978478 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" Jul 09 15:30:26.978664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.978504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerDied","Data":"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf"} Jul 09 15:30:26.978664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.978578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw" event={"ID":"abe7c3d8-be26-42ed-986d-51bf9dd70c93","Type":"ContainerDied","Data":"780634a072fea1c7c6d1c5c0eee0a9edd5ade2fcb2a1b2e4459f8ee50ac058f2"} Jul 09 15:30:26.978664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.978611 2568 scope.go:117] "RemoveContainer" containerID="4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf" Jul 09 15:30:26.989135 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.989114 2568 scope.go:117] "RemoveContainer" containerID="8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1" Jul 09 15:30:26.997828 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.997807 2568 scope.go:117] "RemoveContainer" containerID="4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf" Jul 09 15:30:26.998147 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:30:26.998125 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf\": container with ID starting with 4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf not found: ID does not exist" containerID="4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf" Jul 09 15:30:26.998199 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.998158 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf"} err="failed to get container status \"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf\": rpc error: code = NotFound desc = could not find container \"4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf\": container with ID starting with 4bcb24297bc0f9b70ae739baa539bcd50445c105a75f2383fb4f529cd1ff9ecf not found: ID does not exist" Jul 09 15:30:26.998199 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.998178 2568 scope.go:117] "RemoveContainer" containerID="8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1" Jul 09 15:30:26.998445 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:30:26.998427 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1\": container with ID starting with 8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1 not found: ID does not exist" containerID="8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1" Jul 09 15:30:26.998502 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:26.998452 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1"} err="failed to get container status \"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1\": rpc error: code = NotFound desc = could not find container \"8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1\": container with ID starting with 8fc22815e46f24afcba505498e8464473e76e8a90b8c0090b52b10dcdf811aa1 not found: ID does not exist" Jul 09 15:30:27.005060 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:27.005028 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:30:27.012366 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:27.012340 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-88802e-openshift-default-799f5c58f-wxdlw"] Jul 09 15:30:28.097869 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:28.097830 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" path="/var/lib/kubelet/pods/abe7c3d8-be26-42ed-986d-51bf9dd70c93/volumes" Jul 09 15:30:29.907666 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.907622 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.907978 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.907990 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.908005 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.908011 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.908072 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.908143 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.908081 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe7c3d8-be26-42ed-986d-51bf9dd70c93" containerName="istio-proxy" Jul 09 15:30:29.912760 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.912738 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.918185 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.918157 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bf561e-openshift-default-dockercfg-kn5xs\"" Jul 09 15:30:29.926649 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.926618 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:30:29.974717 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.974668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.974717 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.974720 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975022 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.974829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975022 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.974939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975022 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.974971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975022 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.975001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975225 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.975027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vnd\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975225 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.975064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:29.975225 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:29.975131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.076620 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.076620 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.076620 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vnd\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077134 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.076849 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077475 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.077171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077475 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.077199 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077475 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.077286 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077475 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.077406 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.077617 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.077472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.079229 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.079204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.079555 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.079463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.087439 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.087365 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vnd\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.087439 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.087374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token\") pod \"e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.225340 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.225232 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:30.378630 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.378600 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:30:30.381078 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:30:30.381049 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cb2721_7050_4c76_ba4e_586f2e666da5.slice/crio-7fa71529b359884b66ef0b6b2d1bb02d832537aacccff0c9189ac65e072af0d9 WatchSource:0}: Error finding container 7fa71529b359884b66ef0b6b2d1bb02d832537aacccff0c9189ac65e072af0d9: Status 404 returned error can't find the container with id 7fa71529b359884b66ef0b6b2d1bb02d832537aacccff0c9189ac65e072af0d9 Jul 09 15:30:30.383369 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.383332 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:30.383458 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.383443 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:30.383505 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:30.383483 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:31.002534 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:31.002498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerStarted","Data":"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086"} Jul 09 15:30:31.002933 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:31.002553 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerStarted","Data":"7fa71529b359884b66ef0b6b2d1bb02d832537aacccff0c9189ac65e072af0d9"} Jul 09 15:30:31.029513 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:31.029454 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podStartSLOduration=2.029432446 podStartE2EDuration="2.029432446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:31.02711024 +0000 UTC m=+2097.641694106" watchObservedRunningTime="2026-07-09 15:30:31.029432446 +0000 UTC m=+2097.644016300" Jul 09 15:30:31.225592 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:31.225547 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:31.230773 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:31.230742 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:32.007728 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:32.007694 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:32.008738 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:32.008713 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:38.508130 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:38.508086 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:30:46.471732 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:46.471688 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:30:48.051632 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:48.051530 2568 patch_prober.go:28] interesting pod/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 15:30:48.051632 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:48.051607 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 15:30:49.106224 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.106185 2568 generic.go:356] "Generic (PLEG): container finished" podID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerID="a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086" exitCode=0 Jul 09 15:30:49.106224 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.106225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerDied","Data":"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086"} Jul 09 15:30:49.107091 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.107057 2568 scope.go:117] "RemoveContainer" containerID="a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086" Jul 09 15:30:49.113947 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.113916 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:49.114047 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.114009 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:49.114085 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:49.114045 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 15:30:50.113263 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:50.113224 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerStarted","Data":"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268"} Jul 09 15:30:50.226030 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:50.225989 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:50.226487 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:50.226455 2568 patch_prober.go:28] interesting pod/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 09 15:30:50.226693 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:50.226664 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 09 15:30:51.226815 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:51.226770 2568 patch_prober.go:28] interesting pod/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 09 15:30:51.227405 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:51.226848 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 09 15:30:52.227102 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:52.226610 2568 patch_prober.go:28] interesting pod/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 09 15:30:52.227102 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:52.226684 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 09 15:30:53.226492 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:53.225989 2568 patch_prober.go:28] interesting pod/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 09 15:30:53.226492 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:53.226058 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 09 15:30:54.230004 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:54.229966 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:54.230569 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:54.230250 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:30:54.231148 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:30:54.231127 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:31:03.579179 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:31:03.579138 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:31:38.975211 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:31:38.975167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:31:55.675768 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:31:55.675725 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:32:14.178504 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:32:14.178450 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:32:30.780384 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:32:30.780339 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:32:48.104817 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:32:48.104781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:33:07.483420 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:33:07.483322 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:33:24.974348 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:33:24.974313 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:33:42.570243 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:33:42.570204 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:33:57.675472 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:33:57.675439 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:34:49.310129 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:34:49.310085 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:35:06.674536 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:06.674495 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:35:21.077486 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.077448 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:35:21.081244 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.081218 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.084402 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.084339 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"kube-root-ca.crt\"" Jul 09 15:35:21.085588 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.085549 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"openshift-service-ca.crt\"" Jul 09 15:35:21.085734 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.085607 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"rate-test-model-bf561e-kserve-self-signed-certs\"" Jul 09 15:35:21.085734 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.085621 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"default-dockercfg-9xd5k\"" Jul 09 15:35:21.094421 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.091754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:35:21.195951 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.195903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.195951 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.195949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.196188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.195979 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjmm8\" (UniqueName: \"kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.196188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.196067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.196188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.196106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.196188 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.196150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.296888 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.296840 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.296888 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.296884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297164 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.296904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjmm8\" (UniqueName: \"kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297164 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.296922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297164 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.297045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297164 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.297109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297365 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.297284 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297446 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.297418 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.297503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.297484 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.299292 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.299270 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.299412 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.299365 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.307663 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.307633 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjmm8\" (UniqueName: \"kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8\") pod \"rate-test-model-bf561e-kserve-6fcc9df99-g6psq\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.391842 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.391745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:21.535601 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:21.535534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:35:21.538816 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:35:21.538782 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode55355aa_a549_4948_8080_c723afb0fab8.slice/crio-aded55ad76d939a8d1eb7eb2149ea65cff5cca59e8febe77fb9b728136ae98e6 WatchSource:0}: Error finding container aded55ad76d939a8d1eb7eb2149ea65cff5cca59e8febe77fb9b728136ae98e6: Status 404 returned error can't find the container with id aded55ad76d939a8d1eb7eb2149ea65cff5cca59e8febe77fb9b728136ae98e6 Jul 09 15:35:22.483705 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:22.483666 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" event={"ID":"e55355aa-a549-4948-8080-c723afb0fab8","Type":"ContainerStarted","Data":"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5"} Jul 09 15:35:22.484202 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:22.483714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" event={"ID":"e55355aa-a549-4948-8080-c723afb0fab8","Type":"ContainerStarted","Data":"aded55ad76d939a8d1eb7eb2149ea65cff5cca59e8febe77fb9b728136ae98e6"} Jul 09 15:35:22.506244 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:22.506189 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" podStartSLOduration=1.5061697760000001 podStartE2EDuration="1.506169776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:35:22.504652343 +0000 UTC m=+2389.119236196" watchObservedRunningTime="2026-07-09 15:35:22.506169776 +0000 UTC m=+2389.120753684" Jul 09 15:35:27.879259 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:27.879216 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:35:31.392549 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:31.392501 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:31.393034 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:31.392583 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:31.405366 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:31.405336 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:31.545423 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:31.545374 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:35:46.879503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:35:46.879466 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:36:01.277223 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:01.277133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:36:23.571478 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:23.571440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:36:27.417256 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:27.417218 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:36:39.172001 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:39.171959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:36:42.438562 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.438511 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" podUID="e55355aa-a549-4948-8080-c723afb0fab8" containerName="main" containerID="cri-o://7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5" gracePeriod=45 Jul 09 15:36:42.699150 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.699075 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:36:42.780196 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780162 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjmm8\" (UniqueName: \"kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780196 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780203 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780239 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780271 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780503 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780331 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache\") pod \"e55355aa-a549-4948-8080-c723afb0fab8\" (UID: \"e55355aa-a549-4948-8080-c723afb0fab8\") " Jul 09 15:36:42.780724 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780642 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home" (OuterVolumeSpecName: "home") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:36:42.780724 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780657 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:36:42.780865 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.780833 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache" (OuterVolumeSpecName: "model-cache") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:36:42.782696 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.782670 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8" (OuterVolumeSpecName: "kube-api-access-xjmm8") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "kube-api-access-xjmm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:36:42.782964 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.782938 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm" (OuterVolumeSpecName: "dshm") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:36:42.782964 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.782953 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e55355aa-a549-4948-8080-c723afb0fab8" (UID: "e55355aa-a549-4948-8080-c723afb0fab8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:36:42.881770 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881724 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjmm8\" (UniqueName: \"kubernetes.io/projected/e55355aa-a549-4948-8080-c723afb0fab8-kube-api-access-xjmm8\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.881770 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881762 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55355aa-a549-4948-8080-c723afb0fab8-tls-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.881770 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881774 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-dshm\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.881770 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881784 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-home\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.882071 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881795 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-tmp-dir\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.882071 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.881806 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55355aa-a549-4948-8080-c723afb0fab8-model-cache\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:36:42.898190 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.898153 2568 generic.go:356] "Generic (PLEG): container finished" podID="e55355aa-a549-4948-8080-c723afb0fab8" containerID="7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5" exitCode=0 Jul 09 15:36:42.898385 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.898202 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" Jul 09 15:36:42.898385 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.898253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" event={"ID":"e55355aa-a549-4948-8080-c723afb0fab8","Type":"ContainerDied","Data":"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5"} Jul 09 15:36:42.898385 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.898297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq" event={"ID":"e55355aa-a549-4948-8080-c723afb0fab8","Type":"ContainerDied","Data":"aded55ad76d939a8d1eb7eb2149ea65cff5cca59e8febe77fb9b728136ae98e6"} Jul 09 15:36:42.898385 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.898320 2568 scope.go:117] "RemoveContainer" containerID="7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5" Jul 09 15:36:42.908628 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.908607 2568 scope.go:117] "RemoveContainer" containerID="7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5" Jul 09 15:36:42.908912 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:36:42.908886 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5\": container with ID starting with 7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5 not found: ID does not exist" containerID="7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5" Jul 09 15:36:42.909017 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.908919 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5"} err="failed to get container status \"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5\": rpc error: code = NotFound desc = could not find container \"7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5\": container with ID starting with 7637511b84c4c536147167e3b829dfc3970153d6d2ef0b8d4fb6b1fefc85eaa5 not found: ID does not exist" Jul 09 15:36:42.921836 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.921801 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:36:42.926656 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:42.926616 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/rate-test-model-bf561e-kserve-6fcc9df99-g6psq"] Jul 09 15:36:44.099032 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:44.098996 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e55355aa-a549-4948-8080-c723afb0fab8" path="/var/lib/kubelet/pods/e55355aa-a549-4948-8080-c723afb0fab8/volumes" Jul 09 15:36:52.274950 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:52.274909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:36:55.038687 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:55.038649 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:36:55.039140 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:36:55.038891 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" containerID="cri-o://a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268" gracePeriod=30 Jul 09 15:37:00.297318 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.297287 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:37:00.453819 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.453780 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.453831 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.453878 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.453922 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.453964 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5vnd\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454004 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454038 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454026 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454327 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454078 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454327 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454113 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs\") pod \"32cb2721-7050-4c76-ba4e-586f2e666da5\" (UID: \"32cb2721-7050-4c76-ba4e-586f2e666da5\") " Jul 09 15:37:00.454327 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454178 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:00.454327 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454237 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:00.454327 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454293 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:00.454585 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454490 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:00.454585 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454494 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cb2721-7050-4c76-ba4e-586f2e666da5-istiod-ca-cert\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.454585 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454536 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-socket\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.454585 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.454553 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-credential-socket\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.455053 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.455019 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data" (OuterVolumeSpecName: "istio-data") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:00.456502 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.456478 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:00.456616 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.456490 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd" (OuterVolumeSpecName: "kube-api-access-p5vnd") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "kube-api-access-p5vnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:00.456782 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.456762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:37:00.457034 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.457017 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token" (OuterVolumeSpecName: "istio-token") pod "32cb2721-7050-4c76-ba4e-586f2e666da5" (UID: "32cb2721-7050-4c76-ba4e-586f2e666da5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:00.555721 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555677 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-podinfo\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.555721 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555714 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-workload-certs\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.555721 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555724 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-envoy\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.555721 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555732 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5vnd\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-kube-api-access-p5vnd\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.556081 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555742 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-token\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.556081 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.555751 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cb2721-7050-4c76-ba4e-586f2e666da5-istio-data\") on node \"ip-10-0-133-241.ec2.internal\" DevicePath \"\"" Jul 09 15:37:00.991469 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.991430 2568 generic.go:356] "Generic (PLEG): container finished" podID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerID="a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268" exitCode=0 Jul 09 15:37:00.991684 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.991476 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" Jul 09 15:37:00.991684 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.991510 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerDied","Data":"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268"} Jul 09 15:37:00.991684 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.991570 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt" event={"ID":"32cb2721-7050-4c76-ba4e-586f2e666da5","Type":"ContainerDied","Data":"7fa71529b359884b66ef0b6b2d1bb02d832537aacccff0c9189ac65e072af0d9"} Jul 09 15:37:00.991684 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:00.991604 2568 scope.go:117] "RemoveContainer" containerID="a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268" Jul 09 15:37:01.001996 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.001975 2568 scope.go:117] "RemoveContainer" containerID="a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086" Jul 09 15:37:01.010599 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.010566 2568 scope.go:117] "RemoveContainer" containerID="a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268" Jul 09 15:37:01.010882 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:37:01.010866 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268\": container with ID starting with a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268 not found: ID does not exist" containerID="a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268" Jul 09 15:37:01.010922 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.010892 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268"} err="failed to get container status \"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268\": rpc error: code = NotFound desc = could not find container \"a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268\": container with ID starting with a74e93f2e7f787fc353548b8d904206ec4a01d685cd124e231190564fd3cb268 not found: ID does not exist" Jul 09 15:37:01.010922 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.010910 2568 scope.go:117] "RemoveContainer" containerID="a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086" Jul 09 15:37:01.011141 ip-10-0-133-241 kubenswrapper[2568]: E0709 15:37:01.011121 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086\": container with ID starting with a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086 not found: ID does not exist" containerID="a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086" Jul 09 15:37:01.011185 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.011148 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086"} err="failed to get container status \"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086\": rpc error: code = NotFound desc = could not find container \"a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086\": container with ID starting with a8e5df8b610cf2f1c97f3925a9135006cfe5115d9f4ff26b712ffbb7f8cad086 not found: ID does not exist" Jul 09 15:37:01.017532 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.017500 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:37:01.023437 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:01.023409 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bf561e-openshift-default-6fdd455b8c-6v5nt"] Jul 09 15:37:02.097987 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:02.097944 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" path="/var/lib/kubelet/pods/32cb2721-7050-4c76-ba4e-586f2e666da5/volumes" Jul 09 15:37:05.877970 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:05.877932 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-btmpm"] Jul 09 15:37:09.737853 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:09.737811 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-6bb2m_d3169823-b2f9-4677-bf0e-54f69628a01f/manager/0.log" Jul 09 15:37:09.746260 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:09.746236 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-6bb2m_d3169823-b2f9-4677-bf0e-54f69628a01f/copy-manifests/0.log" Jul 09 15:37:12.427853 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:12.427826 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-btmpm_30e7d694-5b3f-41dc-8a9f-7caf81b64a16/limitador/0.log" Jul 09 15:37:13.036766 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:13.036731 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hwlrj_5ef56fcc-a680-4d3e-84e4-2bcda372e1c4/discovery/0.log" Jul 09 15:37:13.746720 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:13.746667 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5968cb5cc4-cbdz6_21f143ed-764c-4902-9b39-83dd30c071b9/router/0.log" Jul 09 15:37:14.589155 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:14.589121 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rkvn7_63af90ed-3831-4380-91bc-a0aee5d64c31/main/0.log" Jul 09 15:37:22.829439 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:22.829403 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hfdgn_ace0a276-2479-4e01-9a67-7361156c2c2b/global-pull-secret-syncer/0.log" Jul 09 15:37:22.968263 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:22.968221 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9mlsj_9659f084-c36c-4e99-87c9-ba6d4405e4bc/konnectivity-agent/0.log" Jul 09 15:37:23.050355 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:23.050319 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-241.ec2.internal_9589e3ff13c764f99fd24813eb6a730b/haproxy/0.log" Jul 09 15:37:28.828774 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:28.828740 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-btmpm_30e7d694-5b3f-41dc-8a9f-7caf81b64a16/limitador/0.log" Jul 09 15:37:30.564850 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.564817 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/alertmanager/0.log" Jul 09 15:37:30.600247 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.600218 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/config-reloader/0.log" Jul 09 15:37:30.626804 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.626775 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/kube-rbac-proxy-web/0.log" Jul 09 15:37:30.655974 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.655938 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/kube-rbac-proxy/0.log" Jul 09 15:37:30.690501 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.690466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/kube-rbac-proxy-metric/0.log" Jul 09 15:37:30.717252 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.717222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/prom-label-proxy/0.log" Jul 09 15:37:30.749663 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.749635 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ed825c2-e065-4eae-94ca-f25b9da15243/init-config-reloader/0.log" Jul 09 15:37:30.816623 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.816528 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-6vcgx_53ef0581-7b5b-4a22-9c7d-1b43cf4e5b93/cluster-monitoring-operator/0.log" Jul 09 15:37:30.849083 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.849049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z57vd_09e2719e-2829-42e3-854a-3863e98a5ab3/kube-state-metrics/0.log" Jul 09 15:37:30.890479 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.890443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z57vd_09e2719e-2829-42e3-854a-3863e98a5ab3/kube-rbac-proxy-main/0.log" Jul 09 15:37:30.925597 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:30.925564 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z57vd_09e2719e-2829-42e3-854a-3863e98a5ab3/kube-rbac-proxy-self/0.log" Jul 09 15:37:31.002198 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.002156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bj68l_7105030a-ceff-4c0a-bdbb-86c5f4a68256/monitoring-plugin/0.log" Jul 09 15:37:31.141273 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.141240 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2tkm_708599f9-6219-4de4-bc88-f2fa5d0d69ca/node-exporter/0.log" Jul 09 15:37:31.177629 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.177599 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2tkm_708599f9-6219-4de4-bc88-f2fa5d0d69ca/kube-rbac-proxy/0.log" Jul 09 15:37:31.206366 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.206336 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2tkm_708599f9-6219-4de4-bc88-f2fa5d0d69ca/init-textfile/0.log" Jul 09 15:37:31.809094 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.809064 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5777f5779d-kzxb6_4528776b-b240-4796-b8c4-3313dd2bf3a5/telemeter-client/0.log" Jul 09 15:37:31.848945 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.848915 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5777f5779d-kzxb6_4528776b-b240-4796-b8c4-3313dd2bf3a5/reload/0.log" Jul 09 15:37:31.890319 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:31.890287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5777f5779d-kzxb6_4528776b-b240-4796-b8c4-3313dd2bf3a5/kube-rbac-proxy/0.log" Jul 09 15:37:32.027572 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.027537 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7"] Jul 09 15:37:32.028057 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028036 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" Jul 09 15:37:32.028057 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028059 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028075 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55355aa-a549-4948-8080-c723afb0fab8" containerName="main" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028085 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55355aa-a549-4948-8080-c723afb0fab8" containerName="main" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028099 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028107 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028200 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="32cb2721-7050-4c76-ba4e-586f2e666da5" containerName="istio-proxy" Jul 09 15:37:32.028245 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.028208 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e55355aa-a549-4948-8080-c723afb0fab8" containerName="main" Jul 09 15:37:32.031441 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.031423 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.034406 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.034368 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"openshift-service-ca.crt\"" Jul 09 15:37:32.035610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.035588 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wn7sj\"/\"default-dockercfg-6vsgb\"" Jul 09 15:37:32.035680 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.035589 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"kube-root-ca.crt\"" Jul 09 15:37:32.044586 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.044555 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7"] Jul 09 15:37:32.126456 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.126375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-lib-modules\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.126456 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.126456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-proc\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.126704 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.126566 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54h8\" (UniqueName: \"kubernetes.io/projected/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-kube-api-access-k54h8\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.126704 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.126598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-sys\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.126772 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.126696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-podres\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228039 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.227998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-podres\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228232 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-lib-modules\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228232 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-proc\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228232 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k54h8\" (UniqueName: \"kubernetes.io/projected/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-kube-api-access-k54h8\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228232 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-sys\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228232 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-podres\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228485 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-proc\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228485 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228269 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-lib-modules\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.228485 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.228307 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-sys\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.238925 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.238899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54h8\" (UniqueName: \"kubernetes.io/projected/6b7f4ef0-f591-48f0-ac94-0f3717a358a8-kube-api-access-k54h8\") pod \"perf-node-gather-daemonset-2ksp7\" (UID: \"6b7f4ef0-f591-48f0-ac94-0f3717a358a8\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.342611 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.342574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:32.491618 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:32.491576 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7"] Jul 09 15:37:32.494150 ip-10-0-133-241 kubenswrapper[2568]: W0709 15:37:32.494109 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6b7f4ef0_f591_48f0_ac94_0f3717a358a8.slice/crio-d757a5ea17f87268fa66ff6d6a117f475ebeef4ff8a5d2e19a9c939a71fe0783 WatchSource:0}: Error finding container d757a5ea17f87268fa66ff6d6a117f475ebeef4ff8a5d2e19a9c939a71fe0783: Status 404 returned error can't find the container with id d757a5ea17f87268fa66ff6d6a117f475ebeef4ff8a5d2e19a9c939a71fe0783 Jul 09 15:37:33.156950 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:33.156917 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" event={"ID":"6b7f4ef0-f591-48f0-ac94-0f3717a358a8","Type":"ContainerStarted","Data":"dc2f91a431add89a644f81433d0167b3dde4f6c51f2578a8684d852f2f39687e"} Jul 09 15:37:33.157355 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:33.156970 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" event={"ID":"6b7f4ef0-f591-48f0-ac94-0f3717a358a8","Type":"ContainerStarted","Data":"d757a5ea17f87268fa66ff6d6a117f475ebeef4ff8a5d2e19a9c939a71fe0783"} Jul 09 15:37:33.157355 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:33.157005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:33.179757 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:33.179700 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" podStartSLOduration=1.179683353 podStartE2EDuration="1.179683353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:33.177112885 +0000 UTC m=+2519.791696765" watchObservedRunningTime="2026-07-09 15:37:33.179683353 +0000 UTC m=+2519.794267207" Jul 09 15:37:34.465887 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:34.465800 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4nrg7_6de59182-b80e-4a4a-8048-51e79adeb67c/download-server/0.log" Jul 09 15:37:36.213007 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:36.212969 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd7jt_35cb6495-0bdc-489a-b709-506000990103/dns/0.log" Jul 09 15:37:36.235008 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:36.234980 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd7jt_35cb6495-0bdc-489a-b709-506000990103/kube-rbac-proxy/0.log" Jul 09 15:37:36.339131 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:36.339097 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8ppp_86327973-5c1a-4dc5-ad80-6284239e5969/dns-node-resolver/0.log" Jul 09 15:37:36.957826 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:36.957785 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c9c79577d-g6qvn_c1832f05-48c4-4cda-b06f-7434cec2f73c/registry/0.log" Jul 09 15:37:37.019426 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:37.019375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdcjs_5f97c5d2-8209-40c5-b489-a5bbedf4b624/node-ca/0.log" Jul 09 15:37:38.425727 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:38.425690 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hwlrj_5ef56fcc-a680-4d3e-84e4-2bcda372e1c4/discovery/0.log" Jul 09 15:37:38.713722 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:38.713633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5968cb5cc4-cbdz6_21f143ed-764c-4902-9b39-83dd30c071b9/router/0.log" Jul 09 15:37:39.172809 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:39.172780 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-2ksp7" Jul 09 15:37:39.507913 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:39.507828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jb9nv_4ef5bf3d-2011-4ad5-8854-7560770716d9/serve-healthcheck-canary/0.log" Jul 09 15:37:40.063361 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:40.063332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67bkd_0fac2573-987b-40c3-bfbf-6b0c6840456d/kube-rbac-proxy/0.log" Jul 09 15:37:40.087243 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:40.087212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67bkd_0fac2573-987b-40c3-bfbf-6b0c6840456d/exporter/0.log" Jul 09 15:37:40.114782 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:40.114732 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67bkd_0fac2573-987b-40c3-bfbf-6b0c6840456d/extractor/0.log" Jul 09 15:37:43.262674 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:43.262632 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hwlrj_5ef56fcc-a680-4d3e-84e4-2bcda372e1c4/discovery/0.log" Jul 09 15:37:43.441675 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:43.441623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-6bb2m_d3169823-b2f9-4677-bf0e-54f69628a01f/manager/0.log" Jul 09 15:37:43.468028 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:43.468003 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-6bb2m_d3169823-b2f9-4677-bf0e-54f69628a01f/copy-manifests/0.log" Jul 09 15:37:43.488050 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:43.488000 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5968cb5cc4-cbdz6_21f143ed-764c-4902-9b39-83dd30c071b9/router/0.log" Jul 09 15:37:44.848664 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:44.848627 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79ccf9794-8m8sp_dc13f2f6-e2e8-4668-bf80-5e1d573f65f7/manager/0.log" Jul 09 15:37:44.889242 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:44.889196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hwlrj_5ef56fcc-a680-4d3e-84e4-2bcda372e1c4/discovery/0.log" Jul 09 15:37:45.072610 ip-10-0-133-241 kubenswrapper[2568]: I0709 15:37:45.072566 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5968cb5cc4-cbdz6_21f143ed-764c-4902-9b39-83dd30c071b9/router/0.log"