Jul 02 21:18:54.089887 ip-10-0-133-168 systemd[1]: Starting Kubernetes Kubelet... Jul 02 21:18:54.495215 ip-10-0-133-168 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:54.495215 ip-10-0-133-168 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 21:18:54.495215 ip-10-0-133-168 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:54.495215 ip-10-0-133-168 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 21:18:54.495215 ip-10-0-133-168 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:54.496014 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.495926 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 21:18:54.501282 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501257 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.501282 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501282 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.501282 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501287 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501290 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501294 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501297 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501300 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501304 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501307 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501309 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501312 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501315 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501317 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501320 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501323 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501326 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501346 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501350 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501353 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501355 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501359 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501361 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.501387 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501364 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501366 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501369 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501371 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501374 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501376 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501379 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501381 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501384 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501386 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501389 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501392 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501394 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501397 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501400 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501403 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501406 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501408 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501411 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501414 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.501919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501416 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501418 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501420 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501423 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501425 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501427 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501430 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501433 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501435 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501438 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501440 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501442 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501445 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501447 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501450 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501453 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501456 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501459 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501461 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501464 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.502398 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501467 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501469 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501472 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501474 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501477 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501479 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501481 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501484 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501486 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501488 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501491 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501496 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501500 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501503 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501508 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501511 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501514 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501517 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501520 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.502947 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501522 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501525 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501527 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501529 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501532 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501534 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501537 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501541 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501543 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501547 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501551 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501568 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501572 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501574 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501577 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501579 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501582 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.501584 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502313 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502319 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.503406 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502322 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502325 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502328 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502330 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502333 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502336 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502339 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502342 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502345 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502347 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502353 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502356 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502360 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502363 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502366 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502368 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502371 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502373 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502376 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502379 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.503907 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502382 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502384 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502388 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502390 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502393 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502395 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502398 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502401 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502403 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502407 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502409 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502412 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502415 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502417 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502420 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502422 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502425 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502427 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502432 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502434 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.504446 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502437 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502439 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502443 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502445 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502448 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502450 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502452 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502455 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502458 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502460 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502463 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502465 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502467 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502470 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502472 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502475 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502477 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502480 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502482 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.504969 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502484 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502488 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502492 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502494 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502497 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502500 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502502 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502505 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502507 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502509 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502511 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502514 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502518 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502522 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502525 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502528 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502531 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502534 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502537 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.505437 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502539 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502542 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502544 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502547 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502549 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502551 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502572 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502575 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502577 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502580 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502582 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502585 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502588 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502590 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502593 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502595 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502598 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502600 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502603 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.502999 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.505936 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503004 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503007 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503010 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503013 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503016 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503019 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503022 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503025 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503028 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503031 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503033 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503036 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503040 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503043 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503046 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503048 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503050 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503053 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503055 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.506397 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503058 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503060 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503063 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503065 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503068 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503072 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503075 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503078 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503081 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503083 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503086 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503088 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503091 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503094 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503097 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503100 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503103 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503106 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503108 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.506882 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503111 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503114 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503117 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503121 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503124 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503127 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503130 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503132 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503135 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503137 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503139 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503142 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503144 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503147 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503149 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503151 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503154 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503156 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503158 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.507343 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503162 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503164 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503166 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503169 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503171 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503174 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503176 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503178 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503180 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503183 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503186 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503188 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503191 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503193 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503197 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503199 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503201 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503204 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503206 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503208 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.507824 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503211 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503213 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503215 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503218 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503220 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503222 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503225 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503227 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503229 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503232 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503234 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503236 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503239 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503241 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503243 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503246 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503248 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503250 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503253 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503255 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.508315 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503258 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503336 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503344 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503354 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503367 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503371 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503374 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503379 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503384 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503388 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503391 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503394 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503397 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503400 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503403 2580 flags.go:64] FLAG: --cgroup-root="" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503406 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503409 2580 flags.go:64] FLAG: --client-ca-file="" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503413 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503415 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503419 2580 flags.go:64] FLAG: --cluster-domain="" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503422 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503426 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503429 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503433 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 21:18:54.508821 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503437 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503440 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503443 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503447 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503450 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503452 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503455 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503458 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503461 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503465 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503468 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503472 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503475 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503478 2580 flags.go:64] FLAG: --enable-server="true" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503481 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503486 2580 flags.go:64] FLAG: --event-burst="100" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503489 2580 flags.go:64] FLAG: --event-qps="50" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503492 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503495 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503498 2580 flags.go:64] FLAG: --eviction-hard="" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503502 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503504 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503507 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503510 2580 flags.go:64] FLAG: --eviction-soft="" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503513 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 21:18:54.509394 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503515 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503518 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503521 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503524 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503527 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503530 2580 flags.go:64] FLAG: --feature-gates="" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503534 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503537 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503540 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503544 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503547 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503550 2580 flags.go:64] FLAG: --help="false" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503552 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503574 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503579 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503583 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503588 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503593 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503597 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503600 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503603 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503606 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503609 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503612 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 21:18:54.510050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503619 2580 flags.go:64] FLAG: --kube-reserved="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503622 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503625 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503628 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503630 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503633 2580 flags.go:64] FLAG: --lock-file="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503636 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503639 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503642 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503648 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503650 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503653 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503656 2580 flags.go:64] FLAG: --logging-format="text" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503659 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503662 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503665 2580 flags.go:64] FLAG: --manifest-url="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503669 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503673 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503676 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503681 2580 flags.go:64] FLAG: --max-pods="110" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503683 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503686 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503690 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503692 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503695 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 21:18:54.510663 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503698 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503703 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503711 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503714 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503717 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503720 2580 flags.go:64] FLAG: --pod-cidr="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503723 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503728 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503732 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503735 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503738 2580 flags.go:64] FLAG: --port="10250" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503740 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503743 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0797fd8b3ef17cac8" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503746 2580 flags.go:64] FLAG: --qos-reserved="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503749 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503752 2580 flags.go:64] FLAG: --register-node="true" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503755 2580 flags.go:64] FLAG: --register-with-taints="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503758 2580 flags.go:64] FLAG: --registry-burst="10" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503761 2580 flags.go:64] FLAG: --registry-qps="5" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503763 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503766 2580 flags.go:64] FLAG: --reserved-memory="" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503770 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503773 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503776 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503779 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 21:18:54.511275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503782 2580 flags.go:64] FLAG: --runonce="false" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503785 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503788 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503791 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503793 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503796 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503799 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503803 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503806 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503811 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503813 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503816 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503819 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503822 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503825 2580 flags.go:64] FLAG: --system-cgroups="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503827 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503833 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503836 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503839 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503842 2580 flags.go:64] FLAG: --tls-min-version="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503845 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503848 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503850 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503853 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503856 2580 flags.go:64] FLAG: --v="2" Jul 02 21:18:54.511925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503860 2580 flags.go:64] FLAG: --version="false" Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503864 2580 flags.go:64] FLAG: --vmodule="" Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503867 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.503875 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.503995 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504000 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504004 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504008 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504011 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504014 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504017 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504020 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504022 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504024 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504027 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504029 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504033 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504036 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504038 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504041 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.512532 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504043 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504046 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504048 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504051 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504054 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504056 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504059 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504061 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504064 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504066 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504069 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504071 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504074 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504076 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504078 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504082 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504085 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504087 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504090 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504093 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.513112 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504095 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504097 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504100 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504102 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504105 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504108 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504111 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504115 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504119 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504122 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504125 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504127 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504130 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504132 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504135 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504137 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504140 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504143 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504145 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504148 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.513919 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504150 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504152 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504155 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504157 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504159 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504162 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504164 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504168 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504170 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504172 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504175 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504177 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504180 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504182 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504184 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504187 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504189 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504192 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504194 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.514761 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504198 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504202 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504205 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504207 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504210 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504212 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504214 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504217 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504219 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504221 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504224 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504226 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504229 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504231 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504234 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504236 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504239 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504241 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504244 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504246 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.515240 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504249 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.515739 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504252 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.515739 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504254 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.515739 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.504257 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.515739 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.504846 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:54.515739 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.515726 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.515747 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.515770 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.515776 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515842 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515849 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515853 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515855 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515859 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515862 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515865 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515868 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515870 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515873 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515876 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515879 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.515875 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515882 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515884 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515887 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515890 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515892 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515895 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515897 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515900 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515902 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515905 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515907 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515910 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515912 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515916 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515918 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515921 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515923 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515926 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515928 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515931 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.516260 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515934 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515937 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515940 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515943 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515945 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515947 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515950 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515952 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515955 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515957 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515960 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515962 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515965 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515967 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515971 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515974 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515977 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515979 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515982 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515986 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.516774 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515990 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515993 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515995 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.515998 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516001 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516003 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516006 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516008 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516011 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516014 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516016 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516019 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516021 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516024 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516026 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516028 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516031 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516033 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516037 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.517256 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516040 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516043 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516046 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516049 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516052 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516054 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516057 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516061 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516064 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516066 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516069 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516072 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516074 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516076 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516079 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516081 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516084 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516086 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516089 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516091 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.517729 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516093 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516096 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516099 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516101 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516103 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516108 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516111 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516114 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.516119 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516244 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516249 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516252 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516254 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516258 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:54.518218 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516260 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516263 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516266 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516268 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516271 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516275 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516278 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516282 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516284 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516287 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516289 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516292 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516294 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516307 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516310 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516312 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516315 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516317 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516320 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516322 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:54.518585 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516325 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516327 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516329 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516332 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516334 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516337 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516340 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516343 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516345 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516347 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516350 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516352 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516354 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516357 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516361 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516365 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516369 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516372 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516374 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516377 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:54.519082 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516380 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516383 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516385 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516387 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516390 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516392 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516395 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516397 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516399 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516402 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516404 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516407 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516409 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516411 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516414 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516416 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516419 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516421 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516424 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516427 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:54.519576 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516429 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516431 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516434 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516436 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516438 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516441 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516443 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516445 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516448 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516452 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516456 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516459 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516461 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516465 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516468 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516470 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516473 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516475 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516478 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:54.520061 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516480 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516483 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516485 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516487 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516490 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516492 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516495 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516498 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516501 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516504 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516507 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516510 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516513 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516516 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:54.516518 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:54.520544 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.516523 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:54.521034 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.516699 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 21:18:54.521034 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.519250 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 21:18:54.521034 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.520704 2580 server.go:1019] "Starting client certificate rotation" Jul 02 21:18:54.521034 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.520815 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:54.521034 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.520867 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:54.523249 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.523230 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:54.526084 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.526060 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:54.538820 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.538792 2580 log.go:25] "Validated CRI v1 runtime API" Jul 02 21:18:54.541009 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.540991 2580 log.go:25] "Validated CRI v1 image API" Jul 02 21:18:54.541916 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.541901 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 21:18:54.544115 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.544078 2580 fs.go:135] Filesystem UUIDs: map[560d1ad8-8f68-417e-bf6f-0ad1f5b26318:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bfbdb29e-49d4-4110-ac57-1204c56ef26a:/dev/nvme0n1p4] Jul 02 21:18:54.544187 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.544127 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 21:18:54.549463 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.549308 2580 manager.go:216] Machine: {Timestamp:2026-07-02 21:18:54.54784184 +0000 UTC m=+0.333067706 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102488 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2390838fb7b334f3e974c0d21f02c7 SystemUUID:ec239083-8fb7-b334-f3e9-74c0d21f02c7 BootID:fc4ee7e7-1286-493b-90bc-b1168b496bc4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:1d:ca:1c:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:1d:ca:1c:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:b9:0f:de:16:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 21:18:54.549463 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.549447 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 21:18:54.549679 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.549570 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 21:18:54.549679 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.549595 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:54.553390 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.553358 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 21:18:54.553537 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.553394 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 21:18:54.554119 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.554107 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 21:18:54.554153 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.554122 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 21:18:54.554153 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.554132 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:54.554848 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.554836 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:54.556045 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.556034 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 21:18:54.558978 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.558961 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:54.559115 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559105 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 21:18:54.559153 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559140 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 02 21:18:54.559181 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559155 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 21:18:54.559181 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559179 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 21:18:54.559231 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559201 2580 kubelet.go:398] "Adding apiserver pod source" Jul 02 21:18:54.559231 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559213 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 21:18:54.559749 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559733 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:54.559819 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.559763 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:54.562946 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.562919 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 21:18:54.564940 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.564923 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 21:18:54.565044 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.564954 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 21:18:54.566102 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566089 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 21:18:54.566154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566107 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 21:18:54.566154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566114 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 21:18:54.566154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566119 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 21:18:54.566154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566128 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 21:18:54.566154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.566134 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 21:18:54.567073 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567061 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 21:18:54.567073 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567073 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 21:18:54.567130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567082 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 21:18:54.567130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567092 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 21:18:54.567130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567101 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 21:18:54.567130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.567110 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 21:18:54.568574 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.568541 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 21:18:54.568574 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.568573 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 21:18:54.570267 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.570225 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 21:18:54.570418 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.570393 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 21:18:54.572120 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.572102 2580 server.go:1268] "Started kubelet" Jul 02 21:18:54.572224 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.572188 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 21:18:54.572270 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.572196 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 21:18:54.572317 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.572277 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 21:18:54.573154 ip-10-0-133-168 systemd[1]: Started Kubernetes Kubelet. Jul 02 21:18:54.573385 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.573349 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 21:18:54.574260 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.574241 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 21:18:54.574461 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.574446 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 02 21:18:54.577093 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.577072 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 21:18:54.579470 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.578641 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-168.ec2.internal.18be95bb650d087a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-168.ec2.internal,UID:ip-10-0-133-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-168.ec2.internal,},FirstTimestamp:2026-07-02 21:18:54.572071034 +0000 UTC m=+0.357296884,LastTimestamp:2026-07-02 21:18:54.572071034 +0000 UTC m=+0.357296884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-168.ec2.internal,}" Jul 02 21:18:54.579896 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.579880 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 21:18:54.579957 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.579938 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:54.580018 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.579976 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:54.580652 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.580635 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 21:18:54.580652 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.580638 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 21:18:54.580769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.580663 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 21:18:54.580769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.580753 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 02 21:18:54.580769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.580763 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 02 21:18:54.582050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582031 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 21:18:54.582050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582050 2580 factory.go:55] Registering systemd factory Jul 02 21:18:54.582176 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582059 2580 factory.go:223] Registration of the systemd container factory successfully Jul 02 21:18:54.582295 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582280 2580 factory.go:153] Registering CRI-O factory Jul 02 21:18:54.582335 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582300 2580 factory.go:223] Registration of the crio container factory successfully Jul 02 21:18:54.582335 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582319 2580 factory.go:103] Registering Raw factory Jul 02 21:18:54.582335 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582330 2580 manager.go:1196] Started watching for new ooms in manager Jul 02 21:18:54.582778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.582761 2580 manager.go:349] Starting recovery of all containers Jul 02 21:18:54.590110 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.586332 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 21:18:54.590110 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.586330 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 21:18:54.590110 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.588926 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8swgv" Jul 02 21:18:54.594931 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.594755 2580 manager.go:354] Recovery completed Jul 02 21:18:54.596328 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.596306 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8swgv" Jul 02 21:18:54.599294 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.599280 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.601505 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.601485 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.601607 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.601516 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.601607 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.601526 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.602205 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602190 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 21:18:54.602205 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602202 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 21:18:54.602205 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602206 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.602336 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602218 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:54.602926 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602910 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.602989 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602944 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.602989 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.602958 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.603278 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.603266 2580 policy_none.go:49] "None policy: Start" Jul 02 21:18:54.603336 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.603283 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 21:18:54.603336 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.603293 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 21:18:54.604257 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.604245 2580 policy_none.go:47] "Start" Jul 02 21:18:54.604416 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.604341 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-168.ec2.internal.18be95bb66ce1fee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-168.ec2.internal,UID:ip-10-0-133-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-168.ec2.internal,},FirstTimestamp:2026-07-02 21:18:54.601502702 +0000 UTC m=+0.386728547,LastTimestamp:2026-07-02 21:18:54.601502702 +0000 UTC m=+0.386728547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-168.ec2.internal,}" Jul 02 21:18:54.637235 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637213 2580 manager.go:337] "Starting Device Plugin manager" Jul 02 21:18:54.637375 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.637249 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 21:18:54.637375 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637263 2580 server.go:87] "Starting device plugin registration server" Jul 02 21:18:54.637547 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637535 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 21:18:54.637601 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637548 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 21:18:54.637675 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637659 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 21:18:54.637760 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637741 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 21:18:54.637760 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.637756 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 21:18:54.638445 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.638429 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 21:18:54.638512 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.638472 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:54.738055 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.738016 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.739794 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.739764 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.739896 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.739809 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.739896 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.739825 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.739896 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.739853 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.748610 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.748531 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.748610 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.748576 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-168.ec2.internal\": node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:54.754593 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.754534 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 21:18:54.755973 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.755948 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 21:18:54.756073 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.755983 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 21:18:54.756073 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.756003 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 21:18:54.756073 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.756037 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 21:18:54.758990 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.758967 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:54.781622 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.781589 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:54.857184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.857134 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"] Jul 02 21:18:54.857327 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.857227 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.858354 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.858335 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.858428 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.858372 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.858428 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.858382 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.859690 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.859677 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.859834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.859821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.859868 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.859861 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.860531 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860513 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.860628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860546 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.860628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860513 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.860628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860576 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.860628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860590 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.860628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.860602 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.861767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.861751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.861828 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.861780 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:54.864408 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.864389 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:54.864514 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.864427 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:54.864514 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.864451 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:54.881990 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.881958 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:54.883477 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.883457 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-168.ec2.internal\" not found" node="ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.888167 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.888146 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-168.ec2.internal\" not found" node="ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.981551 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.981519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.981700 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.981550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.981700 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:54.981599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7adefaaa136cd969be6ccf9e8d124d5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"7adefaaa136cd969be6ccf9e8d124d5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:54.982586 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:54.982551 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:55.082154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082113 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.082154 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.082332 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.082332 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7adefaaa136cd969be6ccf9e8d124d5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"7adefaaa136cd969be6ccf9e8d124d5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.082332 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7adefaaa136cd969be6ccf9e8d124d5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"7adefaaa136cd969be6ccf9e8d124d5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.082332 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.082295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2d7566db20fda935559500392c4e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"1c2d7566db20fda935559500392c4e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.083236 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.083215 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:55.185515 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.185446 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:55.186690 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.186672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.191263 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.190919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.285688 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.285637 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:55.386410 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.386318 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found" Jul 02 21:18:55.468772 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.468734 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:55.480808 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.480777 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.493774 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.493739 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:55.495679 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.495663 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" Jul 02 21:18:55.506019 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.505991 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:55.520202 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.520167 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 21:18:55.520353 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.520333 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:18:55.520416 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.520393 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:18:55.561624 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.561580 2580 apiserver.go:52] "Watching apiserver" Jul 02 21:18:55.575607 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.575565 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:55.580627 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.580596 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:55.583326 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.583303 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 21:18:55.583738 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.583716 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7rwbj","openshift-dns/node-resolver-48nnv","openshift-multus/multus-additional-cni-plugins-vftx7","openshift-multus/multus-fdk2r","openshift-network-diagnostics/network-check-target-p5c6h","kube-system/global-pull-secret-syncer-x2wx7","kube-system/konnectivity-agent-nbxwk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5","openshift-image-registry/node-ca-xvvtt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal","openshift-multus/network-metrics-daemon-l8mj5","openshift-network-operator/iptables-alerter-xmdms","openshift-ovn-kubernetes/ovnkube-node-9gz4j","kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"] Jul 02 21:18:55.585188 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.585165 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.586420 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.586401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.587778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.587752 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 21:18:55.587888 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.587858 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nw4wl\"" Jul 02 21:18:55.587888 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.587861 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 21:18:55.588350 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.588335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.588662 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.588639 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 21:18:55.589299 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.589275 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6jrwq\"" Jul 02 21:18:55.589391 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.589371 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 21:18:55.589881 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.589864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.590278 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590263 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 21:18:55.590354 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 21:18:55.590354 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590339 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.590785 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590767 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 21:18:55.590858 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 21:18:55.590902 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590876 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s4csq\"" Jul 02 21:18:55.590939 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.590911 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.591266 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.591248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:55.591340 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.591303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:18:55.591398 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.591366 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.591398 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.591378 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 21:18:55.592629 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.592611 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 21:18:55.592629 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.592625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.592813 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.592661 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xfbnc\"" Jul 02 21:18:55.592813 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.592729 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:18:55.593908 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.593893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.595149 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.595081 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:55.595376 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.595360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.596205 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.596186 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 21:18:55.596359 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.596348 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.596794 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.596778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.596943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.596924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.597192 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.597167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.597281 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.597247 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55xtn\"" Jul 02 21:18:55.598038 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.598021 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.598307 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.598293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.598890 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.598868 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.598999 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.598894 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-djhn7\"" Jul 02 21:18:55.599273 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.599254 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.599793 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.599776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v4c28\"" Jul 02 21:18:55.599915 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.599883 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.600097 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.600076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.600202 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.600149 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:18:55.600313 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.600284 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:13:55 +0000 UTC" deadline="2028-03-01 02:12:09.263801148 +0000 UTC" Jul 02 21:18:55.600359 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.600316 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14572h53m13.663488323s" Jul 02 21:18:55.601229 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.601209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 21:18:55.601229 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.601226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.601544 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.601526 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.601727 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.601713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.603078 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.603057 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gv8bp\"" Jul 02 21:18:55.605774 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.605740 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:55.605874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.605788 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cbxjt\"" Jul 02 21:18:55.605874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.605868 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:55.606273 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.606254 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 21:18:55.628767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.628744 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4q2w2" Jul 02 21:18:55.638933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.638776 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4q2w2" Jul 02 21:18:55.682274 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.682250 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 21:18:55.687425 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-netns\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.687600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-var-lib-kubelet\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.687600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm78x\" (UniqueName: \"kubernetes.io/projected/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-kube-api-access-gm78x\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.687600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-binary-copy\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.687600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-os-release\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-systemd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-socket-dir-parent\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-kubelet\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.687836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d53481-14d4-414e-a628-b1d3ad7bdf28-host-slash\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-cni-binary-copy\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-serviceca\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-env-overrides\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-dbus\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-tmp-dir\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-netd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-script-lib\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.687998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rks5g\" (UniqueName: \"kubernetes.io/projected/7f75f1f5-f406-44f8-8737-31ab659331a9-kube-api-access-rks5g\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-daemon-config\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-etc-kubernetes\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-multus\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-cnibin\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-os-release\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f75f1f5-f406-44f8-8737-31ab659331a9-ovn-node-metrics-cert\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688130 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-host\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf5jl\" (UniqueName: \"kubernetes.io/projected/348541db-0e6f-4049-9504-e86f371cfe87-kube-api-access-pf5jl\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpc4v\" (UniqueName: \"kubernetes.io/projected/e4378b38-ddf0-4880-9256-44d68159e682-kube-api-access-bpc4v\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-systemd-units\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-sys\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-kubelet\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-var-lib-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-netns\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c3932-d38d-4020-a8ef-082711c631f7-konnectivity-ca\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-hostroot\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.688733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-multus-certs\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-conf\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-systemd\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-slash\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-log-socket\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-system-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-kubelet-config\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-modprobe-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-run\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d53481-14d4-414e-a628-b1d3ad7bdf28-iptables-alerter-script\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-etc-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-bin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-conf-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-host\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-kubernetes\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.689451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.688983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-tuned\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-ovn\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-node-log\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-bin\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scr7m\" (UniqueName: \"kubernetes.io/projected/bbcd54d7-d5d5-48ff-8728-755550dde21d-kube-api-access-scr7m\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhsz\" (UniqueName: \"kubernetes.io/projected/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-kube-api-access-lqhsz\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-tmp\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-k8s-cni-cncf-io\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b96t\" (UniqueName: \"kubernetes.io/projected/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kube-api-access-4b96t\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd9c3932-d38d-4020-a8ef-082711c631f7-agent-certs\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-cnibin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.690159 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysconfig\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6dj\" (UniqueName: \"kubernetes.io/projected/83d53481-14d4-414e-a628-b1d3ad7bdf28-kube-api-access-5t6dj\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-config\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-lib-modules\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-hosts-file\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpxn\" (UniqueName: \"kubernetes.io/projected/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-kube-api-access-5rpxn\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-system-cni-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.690715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.689644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-device-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.755795 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.755757 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adefaaa136cd969be6ccf9e8d124d5f.slice/crio-ab3bb0d6c15910a19c128205bdba990ea2a4428562fa765df94bcc0ba51d92f3 WatchSource:0}: Error finding container ab3bb0d6c15910a19c128205bdba990ea2a4428562fa765df94bcc0ba51d92f3: Status 404 returned error can't find the container with id ab3bb0d6c15910a19c128205bdba990ea2a4428562fa765df94bcc0ba51d92f3 Jul 02 21:18:55.761778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.761751 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:18:55.762103 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.762063 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2d7566db20fda935559500392c4e0c.slice/crio-e760ccb2f4ee4b0531e86872f0851c081e27b56928f47987204af57ec60223fb WatchSource:0}: Error finding container e760ccb2f4ee4b0531e86872f0851c081e27b56928f47987204af57ec60223fb: Status 404 returned error can't find the container with id e760ccb2f4ee4b0531e86872f0851c081e27b56928f47987204af57ec60223fb Jul 02 21:18:55.790705 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-netd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.790705 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-script-lib\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rks5g\" (UniqueName: \"kubernetes.io/projected/7f75f1f5-f406-44f8-8737-31ab659331a9-kube-api-access-rks5g\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-daemon-config\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-netd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-etc-kubernetes\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-multus\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-cnibin\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790871 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-etc-kubernetes\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-os-release\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f75f1f5-f406-44f8-8737-31ab659331a9-ovn-node-metrics-cert\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-cnibin\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.790966 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-host\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791014 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-os-release\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf5jl\" (UniqueName: \"kubernetes.io/projected/348541db-0e6f-4049-9504-e86f371cfe87-kube-api-access-pf5jl\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpc4v\" (UniqueName: \"kubernetes.io/projected/e4378b38-ddf0-4880-9256-44d68159e682-kube-api-access-bpc4v\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-systemd-units\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.790915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-multus\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.791126 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-sys\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-host\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-sys\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.791294 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:56.291270233 +0000 UTC m=+2.076496069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-kubelet\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791317 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-var-lib-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791390 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.791623 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-netns\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-kubelet\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791465 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-daemon-config\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c3932-d38d-4020-a8ef-082711c631f7-konnectivity-ca\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-var-lib-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-hostroot\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791543 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-netns\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-multus-certs\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-hostroot\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791743 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-multus-certs\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-systemd-units\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.792591 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.791668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-conf\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-systemd\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-slash\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-log-socket\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-system-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-kubelet-config\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-modprobe-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-slash\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-run\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792363 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c3932-d38d-4020-a8ef-082711c631f7-konnectivity-ca\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d53481-14d4-414e-a628-b1d3ad7bdf28-iptables-alerter-script\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-etc-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792423 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-systemd\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-log-socket\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792475 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-run\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.793379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-script-lib\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-bin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792539 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-etc-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792541 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-kubelet-config\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-conf-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792481 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-conf\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792390 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-system-cni-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-host\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-cni-bin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-kubernetes\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792673 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-kubernetes\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792584 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-conf-dir\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-tuned\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-host\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-modprobe-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.794306 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-ovn\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-node-log\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-bin\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792918 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-node-log\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-ovn\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-cni-bin\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scr7m\" (UniqueName: \"kubernetes.io/projected/bbcd54d7-d5d5-48ff-8728-755550dde21d-kube-api-access-scr7m\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.792999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d53481-14d4-414e-a628-b1d3ad7bdf28-iptables-alerter-script\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.793006 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhsz\" (UniqueName: \"kubernetes.io/projected/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-kube-api-access-lqhsz\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-tmp\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.793072 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:56.293049406 +0000 UTC m=+2.078275249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-k8s-cni-cncf-io\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.795248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-run-k8s-cni-cncf-io\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b96t\" (UniqueName: \"kubernetes.io/projected/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kube-api-access-4b96t\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd9c3932-d38d-4020-a8ef-082711c631f7-agent-certs\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-cnibin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793526 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-cnibin\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-openvswitch\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysconfig\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6dj\" (UniqueName: \"kubernetes.io/projected/83d53481-14d4-414e-a628-b1d3ad7bdf28-kube-api-access-5t6dj\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-config\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-lib-modules\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-hosts-file\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793859 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysconfig\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.793934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-hosts-file\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpxn\" (UniqueName: \"kubernetes.io/projected/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-kube-api-access-5rpxn\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.796056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-system-cni-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-device-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-netns\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-var-lib-kubelet\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794311 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/348541db-0e6f-4049-9504-e86f371cfe87-system-cni-dir\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm78x\" (UniqueName: \"kubernetes.io/projected/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-kube-api-access-gm78x\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-ovnkube-config\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-binary-copy\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-os-release\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-systemd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-lib-modules\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-socket-dir-parent\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-kubelet\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794544 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-device-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.796882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d53481-14d4-414e-a628-b1d3ad7bdf28-host-slash\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-cni-binary-copy\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794589 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-host-run-netns\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-serviceca\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-env-overrides\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-dbus\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-tmp-dir\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795044 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-tmp-dir\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-os-release\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/348541db-0e6f-4049-9504-e86f371cfe87-cni-binary-copy\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-host-var-lib-kubelet\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f75f1f5-f406-44f8-8737-31ab659331a9-run-systemd\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcd54d7-d5d5-48ff-8728-755550dde21d-multus-socket-dir-parent\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795264 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-sysctl-d\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795364 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bd1f137-236c-40e6-a679-77e03159e3c9-dbus\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795749 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d53481-14d4-414e-a628-b1d3ad7bdf28-host-slash\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795958 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f75f1f5-f406-44f8-8737-31ab659331a9-env-overrides\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.797677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.795984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f75f1f5-f406-44f8-8737-31ab659331a9-ovn-node-metrics-cert\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.796019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-serviceca\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.794644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-var-lib-kubelet\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.796114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-tmp\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.796180 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-etc-tuned\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.796288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcd54d7-d5d5-48ff-8728-755550dde21d-cni-binary-copy\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.798558 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.797716 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd9c3932-d38d-4020-a8ef-082711c631f7-agent-certs\") pod \"konnectivity-agent-nbxwk\" (UID: \"bd9c3932-d38d-4020-a8ef-082711c631f7\") " pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.814779 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.814737 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpc4v\" (UniqueName: \"kubernetes.io/projected/e4378b38-ddf0-4880-9256-44d68159e682-kube-api-access-bpc4v\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:55.819687 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.819655 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhsz\" (UniqueName: \"kubernetes.io/projected/f77ee42a-d401-43a7-ab64-aa6fda52b1f7-kube-api-access-lqhsz\") pod \"node-ca-xvvtt\" (UID: \"f77ee42a-d401-43a7-ab64-aa6fda52b1f7\") " pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.819840 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.819659 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpxn\" (UniqueName: \"kubernetes.io/projected/4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde-kube-api-access-5rpxn\") pod \"node-resolver-48nnv\" (UID: \"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde\") " pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.856862 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.856831 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf5jl\" (UniqueName: \"kubernetes.io/projected/348541db-0e6f-4049-9504-e86f371cfe87-kube-api-access-pf5jl\") pod \"multus-additional-cni-plugins-vftx7\" (UID: \"348541db-0e6f-4049-9504-e86f371cfe87\") " pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.857002 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.856875 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm78x\" (UniqueName: \"kubernetes.io/projected/1b088969-e2c4-4d23-9770-7f3d4b8dd96a-kube-api-access-gm78x\") pod \"tuned-7rwbj\" (UID: \"1b088969-e2c4-4d23-9770-7f3d4b8dd96a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.857056 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.857001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scr7m\" (UniqueName: \"kubernetes.io/projected/bbcd54d7-d5d5-48ff-8728-755550dde21d-kube-api-access-scr7m\") pod \"multus-fdk2r\" (UID: \"bbcd54d7-d5d5-48ff-8728-755550dde21d\") " pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.857495 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.857467 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6dj\" (UniqueName: \"kubernetes.io/projected/83d53481-14d4-414e-a628-b1d3ad7bdf28-kube-api-access-5t6dj\") pod \"iptables-alerter-xmdms\" (UID: \"83d53481-14d4-414e-a628-b1d3ad7bdf28\") " pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:55.860402 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.860383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rks5g\" (UniqueName: \"kubernetes.io/projected/7f75f1f5-f406-44f8-8737-31ab659331a9-kube-api-access-rks5g\") pod \"ovnkube-node-9gz4j\" (UID: \"7f75f1f5-f406-44f8-8737-31ab659331a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.868616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.868589 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b96t\" (UniqueName: \"kubernetes.io/projected/5a8e32e5-0e0d-41a9-b068-9469aa762bd8-kube-api-access-4b96t\") pod \"aws-ebs-csi-driver-node-btcx5\" (UID: \"5a8e32e5-0e0d-41a9-b068-9469aa762bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:55.871072 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.871047 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:55.871072 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.871071 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:55.871274 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.871083 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:55.871274 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:55.871145 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:56.37112867 +0000 UTC m=+2.156354504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:55.913446 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.913351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:18:55.923801 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.923776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:18:55.925183 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.925158 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9c3932_d38d_4020_a8ef_082711c631f7.slice/crio-5edff8520d3eb6ee0591fae2e63af7880c267c555381f43e46bd9084e35b5fa0 WatchSource:0}: Error finding container 5edff8520d3eb6ee0591fae2e63af7880c267c555381f43e46bd9084e35b5fa0: Status 404 returned error can't find the container with id 5edff8520d3eb6ee0591fae2e63af7880c267c555381f43e46bd9084e35b5fa0 Jul 02 21:18:55.931844 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.931820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vftx7" Jul 02 21:18:55.933100 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.933064 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f75f1f5_f406_44f8_8737_31ab659331a9.slice/crio-d029d11f1d7a13a5bafd066deb61cc0bfa5b293229934ba124efcc8bece6fab3 WatchSource:0}: Error finding container d029d11f1d7a13a5bafd066deb61cc0bfa5b293229934ba124efcc8bece6fab3: Status 404 returned error can't find the container with id d029d11f1d7a13a5bafd066deb61cc0bfa5b293229934ba124efcc8bece6fab3 Jul 02 21:18:55.942238 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.942210 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348541db_0e6f_4049_9504_e86f371cfe87.slice/crio-a7d0e19565217f75b64ff760eaf50fc12db8f3c4f14eb02bb99040b1494ec4d0 WatchSource:0}: Error finding container a7d0e19565217f75b64ff760eaf50fc12db8f3c4f14eb02bb99040b1494ec4d0: Status 404 returned error can't find the container with id a7d0e19565217f75b64ff760eaf50fc12db8f3c4f14eb02bb99040b1494ec4d0 Jul 02 21:18:55.958789 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.958762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fdk2r" Jul 02 21:18:55.964354 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.964327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvvtt" Jul 02 21:18:55.969486 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.969446 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcd54d7_d5d5_48ff_8728_755550dde21d.slice/crio-1588791e0061c18b5d825a10d89aca4fcb28aee32669483b7d2f5bc51bc56a93 WatchSource:0}: Error finding container 1588791e0061c18b5d825a10d89aca4fcb28aee32669483b7d2f5bc51bc56a93: Status 404 returned error can't find the container with id 1588791e0061c18b5d825a10d89aca4fcb28aee32669483b7d2f5bc51bc56a93 Jul 02 21:18:55.977360 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.977334 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77ee42a_d401_43a7_ab64_aa6fda52b1f7.slice/crio-e995ed631c1d834f05538a3ae3d4ca64855b946a9e30744000172f8f50b3d617 WatchSource:0}: Error finding container e995ed631c1d834f05538a3ae3d4ca64855b946a9e30744000172f8f50b3d617: Status 404 returned error can't find the container with id e995ed631c1d834f05538a3ae3d4ca64855b946a9e30744000172f8f50b3d617 Jul 02 21:18:55.982284 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.982262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" Jul 02 21:18:55.987935 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:55.987903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48nnv" Jul 02 21:18:55.993027 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.992993 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b088969_e2c4_4d23_9770_7f3d4b8dd96a.slice/crio-90c8b5bb14b74ce1942cfddcb0fef1a669e76deddc2bb9ccf5d6317215a188ff WatchSource:0}: Error finding container 90c8b5bb14b74ce1942cfddcb0fef1a669e76deddc2bb9ccf5d6317215a188ff: Status 404 returned error can't find the container with id 90c8b5bb14b74ce1942cfddcb0fef1a669e76deddc2bb9ccf5d6317215a188ff Jul 02 21:18:55.999184 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:55.999156 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8ebd78_ac9a_4676_8a2a_49ddb6b90dde.slice/crio-4683df13c60c8d51650af07d0f7d99090576b5b80386198f04d1792a7a8c5450 WatchSource:0}: Error finding container 4683df13c60c8d51650af07d0f7d99090576b5b80386198f04d1792a7a8c5450: Status 404 returned error can't find the container with id 4683df13c60c8d51650af07d0f7d99090576b5b80386198f04d1792a7a8c5450 Jul 02 21:18:56.010913 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.010890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" Jul 02 21:18:56.017208 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.017172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmdms" Jul 02 21:18:56.021434 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:56.021402 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8e32e5_0e0d_41a9_b068_9469aa762bd8.slice/crio-0df504b640f4de13c89ace73a3536d36d64f68ff384ae4b48f6bab1c4b76646b WatchSource:0}: Error finding container 0df504b640f4de13c89ace73a3536d36d64f68ff384ae4b48f6bab1c4b76646b: Status 404 returned error can't find the container with id 0df504b640f4de13c89ace73a3536d36d64f68ff384ae4b48f6bab1c4b76646b Jul 02 21:18:56.026393 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:18:56.026366 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d53481_14d4_414e_a628_b1d3ad7bdf28.slice/crio-0ecf32258ce0de08b86cb3c3fd28ab17f91ba2bb0a52f097e6f0b7af1c8f56fc WatchSource:0}: Error finding container 0ecf32258ce0de08b86cb3c3fd28ab17f91ba2bb0a52f097e6f0b7af1c8f56fc: Status 404 returned error can't find the container with id 0ecf32258ce0de08b86cb3c3fd28ab17f91ba2bb0a52f097e6f0b7af1c8f56fc Jul 02 21:18:56.162588 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.162552 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:56.297826 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.297728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:56.297826 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.297823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:56.298012 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.297911 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:56.298012 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.297973 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:56.298012 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.297996 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:57.297975342 +0000 UTC m=+3.083201199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:56.298147 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.298029 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:57.298012317 +0000 UTC m=+3.083238157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:56.335843 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.335480 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:56.399277 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.399238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:56.399572 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.399551 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:56.399572 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.399583 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:56.399779 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.399637 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:56.399779 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.399729 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:57.399707821 +0000 UTC m=+3.184933662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:56.642718 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.642316 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:56 +0000 UTC" deadline="2028-01-03 08:59:32.852135295 +0000 UTC" Jul 02 21:18:56.642718 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.642357 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13187h40m36.209784222s" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.768790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.769032 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.769601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.769764 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.769868 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:56.770074 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:56.769989 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:18:56.792619 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.792549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" event={"ID":"7adefaaa136cd969be6ccf9e8d124d5f","Type":"ContainerStarted","Data":"ab3bb0d6c15910a19c128205bdba990ea2a4428562fa765df94bcc0ba51d92f3"} Jul 02 21:18:56.798426 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.798384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" event={"ID":"5a8e32e5-0e0d-41a9-b068-9469aa762bd8","Type":"ContainerStarted","Data":"0df504b640f4de13c89ace73a3536d36d64f68ff384ae4b48f6bab1c4b76646b"} Jul 02 21:18:56.814691 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.814647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48nnv" event={"ID":"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde","Type":"ContainerStarted","Data":"4683df13c60c8d51650af07d0f7d99090576b5b80386198f04d1792a7a8c5450"} Jul 02 21:18:56.824930 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.824837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvvtt" event={"ID":"f77ee42a-d401-43a7-ab64-aa6fda52b1f7","Type":"ContainerStarted","Data":"e995ed631c1d834f05538a3ae3d4ca64855b946a9e30744000172f8f50b3d617"} Jul 02 21:18:56.854672 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.854532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmdms" event={"ID":"83d53481-14d4-414e-a628-b1d3ad7bdf28","Type":"ContainerStarted","Data":"0ecf32258ce0de08b86cb3c3fd28ab17f91ba2bb0a52f097e6f0b7af1c8f56fc"} Jul 02 21:18:56.867096 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.867014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" event={"ID":"1b088969-e2c4-4d23-9770-7f3d4b8dd96a","Type":"ContainerStarted","Data":"90c8b5bb14b74ce1942cfddcb0fef1a669e76deddc2bb9ccf5d6317215a188ff"} Jul 02 21:18:56.885695 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.885553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fdk2r" event={"ID":"bbcd54d7-d5d5-48ff-8728-755550dde21d","Type":"ContainerStarted","Data":"1588791e0061c18b5d825a10d89aca4fcb28aee32669483b7d2f5bc51bc56a93"} Jul 02 21:18:56.908497 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.907883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerStarted","Data":"a7d0e19565217f75b64ff760eaf50fc12db8f3c4f14eb02bb99040b1494ec4d0"} Jul 02 21:18:56.933814 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.933612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"d029d11f1d7a13a5bafd066deb61cc0bfa5b293229934ba124efcc8bece6fab3"} Jul 02 21:18:56.949901 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.949771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbxwk" event={"ID":"bd9c3932-d38d-4020-a8ef-082711c631f7","Type":"ContainerStarted","Data":"5edff8520d3eb6ee0591fae2e63af7880c267c555381f43e46bd9084e35b5fa0"} Jul 02 21:18:56.966941 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:56.966904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"1c2d7566db20fda935559500392c4e0c","Type":"ContainerStarted","Data":"e760ccb2f4ee4b0531e86872f0851c081e27b56928f47987204af57ec60223fb"} Jul 02 21:18:57.254530 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.254444 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:57.304655 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.304605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:57.304868 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.304701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:57.304868 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.304839 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:57.304994 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.304926 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:59.304889057 +0000 UTC m=+5.090114908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:57.305065 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.305026 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:57.305065 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.305065 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:59.305051236 +0000 UTC m=+5.090277078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:57.405451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.405410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:57.405678 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.405590 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:57.405678 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.405629 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:57.405678 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.405645 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:57.405876 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:57.405720 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:59.405695661 +0000 UTC m=+5.190921511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:57.643330 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.643208 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:56 +0000 UTC" deadline="2027-12-17 02:40:05.889514185 +0000 UTC" Jul 02 21:18:57.643330 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:57.643281 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12773h21m8.246237553s" Jul 02 21:18:58.767941 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:58.767603 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:58.768505 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:58.767830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:58.768505 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:58.768009 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:18:58.768505 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:58.768076 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:18:58.768505 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:58.767874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:58.768505 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:58.768189 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:18:59.321187 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:59.321147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:18:59.321399 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:59.321221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:18:59.321399 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.321366 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:59.321535 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.321434 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:03.321412731 +0000 UTC m=+9.106638582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:59.321968 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.321945 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:59.322072 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.322011 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:03.321993272 +0000 UTC m=+9.107219129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:59.421831 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:18:59.421788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:18:59.422036 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.421964 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:59.422036 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.421986 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:59.422036 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.422000 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:59.422217 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:18:59.422062 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:03.422042212 +0000 UTC m=+9.207268063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:00.756805 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:00.756764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:00.757305 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:00.756926 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:00.757389 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:00.757341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:00.757472 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:00.757449 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:00.757548 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:00.757512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:00.757598 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:00.757581 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:02.759590 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:02.759552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:02.760005 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:02.759704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:02.760158 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:02.760140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:02.760275 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:02.760243 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:02.760384 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:02.760307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:02.760436 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:02.760394 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:03.361988 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:03.361791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:03.361988 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:03.361865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:03.361988 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.361961 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:03.362291 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.362031 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:11.362011977 +0000 UTC m=+17.147237813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:03.362404 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.361961 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:03.362485 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.362467 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:11.362445242 +0000 UTC m=+17.147671077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:03.463127 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:03.463081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:03.463343 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.463285 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:03.463343 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.463311 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:03.463343 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.463323 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:03.463502 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:03.463390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:11.463369149 +0000 UTC m=+17.248595000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:04.760353 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:04.760314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:04.760870 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:04.760528 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:04.761231 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:04.760955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:04.761231 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:04.761059 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:04.761231 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:04.761109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:04.761231 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:04.761178 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:06.757303 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:06.757168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:06.757303 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:06.757175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:06.757886 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:06.757315 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:06.757886 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:06.757401 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:06.757886 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:06.757176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:06.757886 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:06.757490 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:08.757067 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:08.757025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:08.757067 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:08.757043 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:08.757473 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:08.757036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:08.757473 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:08.757189 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:08.757473 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:08.757304 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:08.757473 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:08.757388 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:10.757029 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:10.756990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:10.757426 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:10.756995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:10.757426 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:10.757130 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:10.757426 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:10.757140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:10.757426 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:10.757240 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:10.757426 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:10.757329 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:11.429520 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:11.429476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:11.429767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:11.429575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:11.429767 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.429663 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:11.429767 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.429684 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:11.429767 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.429740 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.429717579 +0000 UTC m=+33.214943430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:11.429767 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.429759 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.429750932 +0000 UTC m=+33.214976767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:11.530670 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:11.530629 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:11.530871 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.530818 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:11.530871 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.530845 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:11.530871 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.530858 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:11.531022 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:11.530934 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:27.530910125 +0000 UTC m=+33.316135972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:12.756778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:12.756739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:12.757313 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:12.756743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:12.757313 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:12.756872 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:12.757313 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:12.756743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:12.757313 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:12.756967 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:12.757313 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:12.757013 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:14.758174 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:14.758133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:14.758691 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:14.758246 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:14.758769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:14.758697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:14.758821 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:14.758790 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:14.758865 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:14.758843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:14.758943 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:14.758915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:16.756815 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:16.756775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:16.757377 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:16.756840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:16.757377 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:16.756855 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:16.757377 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:16.756961 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:16.757377 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:16.757000 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:16.757377 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:16.757094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:18.027153 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.027117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" event={"ID":"1b088969-e2c4-4d23-9770-7f3d4b8dd96a","Type":"ContainerStarted","Data":"ca47f6b1d19fa0dffd4c4ebaa194a0552bf96b7bccf60a2d8a2802049452a58d"} Jul 02 21:19:18.038242 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.038051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fdk2r" event={"ID":"bbcd54d7-d5d5-48ff-8728-755550dde21d","Type":"ContainerStarted","Data":"f6abaf27c9655571eec02b53c816b2e629b5915f5891d25cf49976658648761d"} Jul 02 21:19:18.046266 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.046234 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:19:18.047419 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.047388 2580 generic.go:356] "Generic (PLEG): container finished" podID="7f75f1f5-f406-44f8-8737-31ab659331a9" containerID="54b8dec1f9cc75095ee9878cd8194ddeb77ff59d0ded2d84ce0fb69020c02ca3" exitCode=1 Jul 02 21:19:18.047578 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.047461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"836be0b875b237ac385aa55fcab6903679d6f86e15ba78a6c0a6f17bab2e12cb"} Jul 02 21:19:18.047578 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.047520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerDied","Data":"54b8dec1f9cc75095ee9878cd8194ddeb77ff59d0ded2d84ce0fb69020c02ca3"} Jul 02 21:19:18.047684 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.047552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"066611c8a8a03037eaa275f553ad94582c7fedcbf0864dfded93924f3acd9711"} Jul 02 21:19:18.049941 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.049915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" event={"ID":"7adefaaa136cd969be6ccf9e8d124d5f","Type":"ContainerStarted","Data":"bdb06b433d8fac3375403b0bc0bf2ff45ef45fd64186e446bb6e0900d3a0537b"} Jul 02 21:19:18.067829 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.067766 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fdk2r" podStartSLOduration=1.420014396 podStartE2EDuration="23.067750749s" totalImagesPullingTime="21.647736353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:18.067646992 +0000 UTC m=+23.852872864" watchObservedRunningTime="2026-07-02 21:19:18.067750749 +0000 UTC m=+23.852976602" Jul 02 21:19:18.068568 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.068523 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7rwbj" podStartSLOduration=1.481564001 podStartE2EDuration="23.068512871s" totalImagesPullingTime="21.58694887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:18.048165662 +0000 UTC m=+23.833391532" watchObservedRunningTime="2026-07-02 21:19:18.068512871 +0000 UTC m=+23.853738727" Jul 02 21:19:18.095741 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.095680 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" podStartSLOduration=22.095655301 podStartE2EDuration="22.095655301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:18.095332851 +0000 UTC m=+23.880558707" watchObservedRunningTime="2026-07-02 21:19:18.095655301 +0000 UTC m=+23.880881158" Jul 02 21:19:18.757212 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.756999 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:18.757398 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.757055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:18.757398 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:18.757299 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:18.757398 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:18.757084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:18.757398 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:18.757368 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:18.757643 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:18.757430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:19.054200 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.053989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmdms" event={"ID":"83d53481-14d4-414e-a628-b1d3ad7bdf28","Type":"ContainerStarted","Data":"779004c03a8879f6f79aad6f486e95526641e68436f657bea5781df5a330398a"} Jul 02 21:19:19.055923 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.055895 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="1ed6c3c8f6d0760a07807327f6f9e97ea60c25b360b91cb63374818ca1b6bd56" exitCode=0 Jul 02 21:19:19.056069 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.055929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"1ed6c3c8f6d0760a07807327f6f9e97ea60c25b360b91cb63374818ca1b6bd56"} Jul 02 21:19:19.059628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.059610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:19:19.060087 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.060066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"e07959c0fd51dd3417eb9ef0cd6fe4e446ad706b90198779239aa56829f33cff"} Jul 02 21:19:19.060173 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.060143 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"f0f9e06b3627c52d29d9c0064dedefd640a5eb9ae7368f1ff9b4d92d7ed6d5ca"} Jul 02 21:19:19.060230 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.060192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"63ac9b2dcc8668010447b948871dde106b58b88fac1c54a953de1e39a3757eff"} Jul 02 21:19:19.061572 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.061530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbxwk" event={"ID":"bd9c3932-d38d-4020-a8ef-082711c631f7","Type":"ContainerStarted","Data":"8ec3a38db8bd147ad06339fec57cd07d42d8b40e324d129fa06496be1a91ab10"} Jul 02 21:19:19.063656 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.063631 2580 generic.go:356] "Generic (PLEG): container finished" podID="1c2d7566db20fda935559500392c4e0c" containerID="a09189fc2fd00ea2a3fab36b0385ba6a74b7f72796fd9c03c5b7a036a1e878e5" exitCode=0 Jul 02 21:19:19.063752 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.063713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"1c2d7566db20fda935559500392c4e0c","Type":"ContainerDied","Data":"a09189fc2fd00ea2a3fab36b0385ba6a74b7f72796fd9c03c5b7a036a1e878e5"} Jul 02 21:19:19.068033 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.068002 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" event={"ID":"5a8e32e5-0e0d-41a9-b068-9469aa762bd8","Type":"ContainerStarted","Data":"1bf5c92c65aafe81746d3d2962db337b0f530268144621ebffdbb45ff7a5e1f0"} Jul 02 21:19:19.070103 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.070077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48nnv" event={"ID":"4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde","Type":"ContainerStarted","Data":"6901f349da557f15b7a65aaa56e167e5a41daef381a31cbf81fb79b67c7f90bc"} Jul 02 21:19:19.071877 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.071849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvvtt" event={"ID":"f77ee42a-d401-43a7-ab64-aa6fda52b1f7","Type":"ContainerStarted","Data":"97dbfae6a1fcd70bb1983def3dfcefd7de66423ad6da8aca3744ba5399effc99"} Jul 02 21:19:19.072087 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.072042 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xmdms" podStartSLOduration=2.5433185910000002 podStartE2EDuration="24.072030327s" totalImagesPullingTime="21.528711736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:19.071677622 +0000 UTC m=+24.856903479" watchObservedRunningTime="2026-07-02 21:19:19.072030327 +0000 UTC m=+24.857256183" Jul 02 21:19:19.116404 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.116337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-48nnv" podStartSLOduration=2.563169511 podStartE2EDuration="24.116314547s" totalImagesPullingTime="21.553145036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:19.093001946 +0000 UTC m=+24.878227803" watchObservedRunningTime="2026-07-02 21:19:19.116314547 +0000 UTC m=+24.901540405" Jul 02 21:19:19.138532 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.138468 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbxwk" podStartSLOduration=2.508974447 podStartE2EDuration="24.138444382s" totalImagesPullingTime="21.629469935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:19.117044592 +0000 UTC m=+24.902270716" watchObservedRunningTime="2026-07-02 21:19:19.138444382 +0000 UTC m=+24.923670243" Jul 02 21:19:19.194367 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.194315 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvvtt" podStartSLOduration=2.614613124 podStartE2EDuration="24.19429501s" totalImagesPullingTime="21.579681886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:19.194267571 +0000 UTC m=+24.979493466" watchObservedRunningTime="2026-07-02 21:19:19.19429501 +0000 UTC m=+24.979520868" Jul 02 21:19:19.961944 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:19.961913 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 21:19:20.028208 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.028173 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:19:20.028922 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.028899 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:19:20.077187 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.077101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"1c2d7566db20fda935559500392c4e0c","Type":"ContainerStarted","Data":"a3f62bc3115aa90622afe502dd92852b2551829afd848394dea6603c36f3e5f8"} Jul 02 21:19:20.080459 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.080426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" event={"ID":"5a8e32e5-0e0d-41a9-b068-9469aa762bd8","Type":"ContainerStarted","Data":"55c457ca37db75dc90dafecb3b25f3ad9732e1fc9cb74a56c00395f6647586c6"} Jul 02 21:19:20.096217 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.096161 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" podStartSLOduration=24.096145741 podStartE2EDuration="24.096145741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:20.095392001 +0000 UTC m=+25.880617857" watchObservedRunningTime="2026-07-02 21:19:20.096145741 +0000 UTC m=+25.881371597" Jul 02 21:19:20.656608 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.656421 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:19:19.961936929Z","UUID":"e24ab1d7-60cf-4b4c-a663-2faa99bbb54d","Handler":null,"Name":"","Endpoint":""} Jul 02 21:19:20.658787 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.658335 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 21:19:20.658787 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.658382 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 21:19:20.756441 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.756408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:20.756441 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.756437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:20.756712 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:20.756538 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:20.756712 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:20.756671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:20.756830 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:20.756802 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:20.756918 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:20.756900 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:21.087063 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:21.086981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:19:21.087631 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:21.087451 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 21:19:21.087631 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:21.087450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"1c3168499418c234ddcbe95be74713f783411fc85be4c7da0334cd32e01c8761"} Jul 02 21:19:22.092228 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:22.092182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" event={"ID":"5a8e32e5-0e0d-41a9-b068-9469aa762bd8","Type":"ContainerStarted","Data":"f775ae078d6236858cca76170d295c0f654248e4b1e14c56f6782a5a40f45ab8"} Jul 02 21:19:22.111529 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:22.111471 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btcx5" podStartSLOduration=3.229974774 podStartE2EDuration="27.111454235s" totalImagesPullingTime="23.881479461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:22.110185313 +0000 UTC m=+27.895411183" watchObservedRunningTime="2026-07-02 21:19:22.111454235 +0000 UTC m=+27.896680169" Jul 02 21:19:22.761468 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:22.761221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:22.761655 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:22.761290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:22.761655 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:22.761509 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:22.761655 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:22.761292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:22.761655 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:22.761606 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:22.761856 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:22.761648 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:23.158094 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:23.158003 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:19:23.158528 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:23.158179 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 21:19:23.158711 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:23.158694 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbxwk" Jul 02 21:19:24.098903 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.098821 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="86255dc20315e9f34d4860cd619ec86cbd6b5c165819f8326028262ef8ddb183" exitCode=0 Jul 02 21:19:24.099039 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.098910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"86255dc20315e9f34d4860cd619ec86cbd6b5c165819f8326028262ef8ddb183"} Jul 02 21:19:24.102446 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.102429 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:19:24.102901 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.102874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"85a647ab939b0fc9eebb805f8111a10f8914bdd210eaf123ae93d0bba19f3da5"} Jul 02 21:19:24.103340 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.103326 2580 scope.go:117] "RemoveContainer" containerID="54b8dec1f9cc75095ee9878cd8194ddeb77ff59d0ded2d84ce0fb69020c02ca3" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.765020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.765052 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:24.765376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:24.765453 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:24.765073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:24.765769 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:24.765538 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:25.109006 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.108916 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:19:25.109382 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.109347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" event={"ID":"7f75f1f5-f406-44f8-8737-31ab659331a9","Type":"ContainerStarted","Data":"ab3d028a721e68dbb57e3f672ddf566a93fae35d86861af88974287ceb954e75"} Jul 02 21:19:25.109645 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.109620 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:25.109723 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.109701 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:25.109770 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.109747 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:25.125689 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.125662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:25.125825 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.125768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:25.153127 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.153084 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" podStartSLOduration=8.457669656 podStartE2EDuration="30.153068028s" totalImagesPullingTime="21.695398372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:25.152664497 +0000 UTC m=+30.937890365" watchObservedRunningTime="2026-07-02 21:19:25.153068028 +0000 UTC m=+30.938293917" Jul 02 21:19:25.741422 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.741386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8mj5"] Jul 02 21:19:25.741686 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.741537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:25.741764 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:25.741681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:25.742163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.742128 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2wx7"] Jul 02 21:19:25.742286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.742211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:25.742349 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:25.742312 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:25.742811 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.742791 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5c6h"] Jul 02 21:19:25.742891 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:25.742859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:25.742946 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:25.742930 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:26.113684 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:26.113651 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="dc974dae9465ce4f3653220cad6b4ae94ca081e31bc6412696b581f3aadb925b" exitCode=0 Jul 02 21:19:26.114146 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:26.113746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"dc974dae9465ce4f3653220cad6b4ae94ca081e31bc6412696b581f3aadb925b"} Jul 02 21:19:27.448265 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.448011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:27.448652 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.448302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:27.448652 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.448168 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:27.448652 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.448399 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret podName:8bd1f137-236c-40e6-a679-77e03159e3c9 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:59.448379133 +0000 UTC m=+65.233604968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret") pod "global-pull-secret-syncer-x2wx7" (UID: "8bd1f137-236c-40e6-a679-77e03159e3c9") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:19:27.448652 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.448412 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:27.448652 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.448458 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs podName:e4378b38-ddf0-4880-9256-44d68159e682 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:59.448445948 +0000 UTC m=+65.233671782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs") pod "network-metrics-daemon-l8mj5" (UID: "e4378b38-ddf0-4880-9256-44d68159e682") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:19:27.549544 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.549512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:27.549710 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.549686 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:19:27.549710 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.549707 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:19:27.549780 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.549717 2580 projected.go:196] Error preparing data for projected volume kube-api-access-qf552 for pod openshift-network-diagnostics/network-check-target-p5c6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:27.549780 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.549774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552 podName:f2f32bda-dd1a-4906-b905-9f2a0765e1f8 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:59.549759842 +0000 UTC m=+65.334985675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qf552" (UniqueName: "kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552") pod "network-check-target-p5c6h" (UID: "f2f32bda-dd1a-4906-b905-9f2a0765e1f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:19:27.756414 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.756337 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:27.756573 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.756344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:27.756573 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:27.756457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:27.756573 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.756440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:27.756573 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.756535 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:27.756712 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:27.756594 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:28.120778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:28.120739 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="23cde9ad45307e5288d60d029396bff871acc970f9734f2918938002e52a57b6" exitCode=0 Jul 02 21:19:28.120958 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:28.120818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"23cde9ad45307e5288d60d029396bff871acc970f9734f2918938002e52a57b6"} Jul 02 21:19:29.757092 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:29.757055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:29.757092 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:29.757067 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:29.757616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:29.757069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:29.757616 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:29.757180 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8mj5" podUID="e4378b38-ddf0-4880-9256-44d68159e682" Jul 02 21:19:29.757616 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:29.757332 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2wx7" podUID="8bd1f137-236c-40e6-a679-77e03159e3c9" Jul 02 21:19:29.757616 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:29.757459 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5c6h" podUID="f2f32bda-dd1a-4906-b905-9f2a0765e1f8" Jul 02 21:19:30.460200 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.460164 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeReady" Jul 02 21:19:30.460462 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.460308 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 21:19:30.517964 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.517929 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mz5ml"] Jul 02 21:19:30.519856 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.519838 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.523719 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.523693 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 21:19:30.523870 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.523700 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 21:19:30.523870 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.523768 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs2b2\"" Jul 02 21:19:30.529012 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.528990 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dvgx8"] Jul 02 21:19:30.530861 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.530840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.537641 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.536798 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhvvb\"" Jul 02 21:19:30.537641 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.537038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 21:19:30.537641 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.537167 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz5ml"] Jul 02 21:19:30.537641 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.537275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 21:19:30.538786 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.538763 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 21:19:30.539733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.539710 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bwl8z"] Jul 02 21:19:30.542834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.542811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.544886 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.544860 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvgx8"] Jul 02 21:19:30.545825 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.545806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 21:19:30.545983 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.545968 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 21:19:30.546140 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.546126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ppvmq\"" Jul 02 21:19:30.546212 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.546196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 21:19:30.546331 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.546312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 21:19:30.553682 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.553661 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 21:19:30.566430 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.566379 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bwl8z"] Jul 02 21:19:30.575716 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.575688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzm4\" (UniqueName: \"kubernetes.io/projected/7414621c-2028-4391-b804-51558b21d753-kube-api-access-4gzm4\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.575878 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.575726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.575878 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.575815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7414621c-2028-4391-b804-51558b21d753-config-volume\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.575878 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.575840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7414621c-2028-4391-b804-51558b21d753-tmp-dir\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.634726 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.634693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6"] Jul 02 21:19:30.636907 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.636886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.638804 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.638780 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55cc8f7f95-rp5gk"] Jul 02 21:19:30.640548 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.640530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.641327 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.641307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xntzj\"" Jul 02 21:19:30.641431 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.641312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:30.641431 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.641367 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 21:19:30.641536 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.641315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:30.641862 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.641843 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 21:19:30.644142 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.644123 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 21:19:30.644740 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.644719 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 21:19:30.645857 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.645834 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z9bsj\"" Jul 02 21:19:30.646052 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.646033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 21:19:30.646165 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.646147 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 21:19:30.646261 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.646244 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 21:19:30.646389 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.646372 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 21:19:30.672549 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.672515 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6"] Jul 02 21:19:30.676839 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.676812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-tmp\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.676985 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.676849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzm4\" (UniqueName: \"kubernetes.io/projected/7414621c-2028-4391-b804-51558b21d753-kube-api-access-4gzm4\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.676985 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.676873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.676985 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.676903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4q9\" (UniqueName: \"kubernetes.io/projected/d25ef769-f55b-4956-b3c1-cd0956c81a20-kube-api-access-vm4q9\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.677111 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.676974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc178907-cf96-496a-8858-a535e8c08dab-serving-cert\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.677111 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:30.677005 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:30.677111 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7414621c-2028-4391-b804-51558b21d753-config-volume\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.677111 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:30.677068 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:31.177048822 +0000 UTC m=+36.962274675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:30.677111 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7414621c-2028-4391-b804-51558b21d753-tmp-dir\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.677285 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d25ef769-f55b-4956-b3c1-cd0956c81a20-cert\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.677285 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-snapshots\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.677285 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxcq\" (UniqueName: \"kubernetes.io/projected/cc178907-cf96-496a-8858-a535e8c08dab-kube-api-access-xxxcq\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.677285 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.677285 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.677483 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677459 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7414621c-2028-4391-b804-51558b21d753-tmp-dir\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.677529 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.677512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7414621c-2028-4391-b804-51558b21d753-config-volume\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.679659 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.679623 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cc8f7f95-rp5gk"] Jul 02 21:19:30.697386 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.697352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzm4\" (UniqueName: \"kubernetes.io/projected/7414621c-2028-4391-b804-51558b21d753-kube-api-access-4gzm4\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:30.778275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d25ef769-f55b-4956-b3c1-cd0956c81a20-cert\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7scm\" (UniqueName: \"kubernetes.io/projected/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-kube-api-access-q7scm\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-default-certificate\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-stats-auth\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-snapshots\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxcq\" (UniqueName: \"kubernetes.io/projected/cc178907-cf96-496a-8858-a535e8c08dab-kube-api-access-xxxcq\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-config\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-tmp\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98bk\" (UniqueName: \"kubernetes.io/projected/669b326b-1e71-4f5b-ac30-d2174600185d-kube-api-access-m98bk\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4q9\" (UniqueName: \"kubernetes.io/projected/d25ef769-f55b-4956-b3c1-cd0956c81a20-kube-api-access-vm4q9\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.778943 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.778824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc178907-cf96-496a-8858-a535e8c08dab-serving-cert\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.779540 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.779336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.779540 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.779532 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-tmp\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.779664 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.779644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc178907-cf96-496a-8858-a535e8c08dab-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.779712 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.779667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc178907-cf96-496a-8858-a535e8c08dab-snapshots\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.781194 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.781169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d25ef769-f55b-4956-b3c1-cd0956c81a20-cert\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.781715 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.781695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc178907-cf96-496a-8858-a535e8c08dab-serving-cert\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.793333 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.793271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxcq\" (UniqueName: \"kubernetes.io/projected/cc178907-cf96-496a-8858-a535e8c08dab-kube-api-access-xxxcq\") pod \"insights-operator-5c847dcfc4-bwl8z\" (UID: \"cc178907-cf96-496a-8858-a535e8c08dab\") " pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.793333 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.793328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4q9\" (UniqueName: \"kubernetes.io/projected/d25ef769-f55b-4956-b3c1-cd0956c81a20-kube-api-access-vm4q9\") pod \"ingress-canary-dvgx8\" (UID: \"d25ef769-f55b-4956-b3c1-cd0956c81a20\") " pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.843369 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.843328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvgx8" Jul 02 21:19:30.854332 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.854291 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" Jul 02 21:19:30.879385 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98bk\" (UniqueName: \"kubernetes.io/projected/669b326b-1e71-4f5b-ac30-d2174600185d-kube-api-access-m98bk\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:30.879527 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7scm\" (UniqueName: \"kubernetes.io/projected/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-kube-api-access-q7scm\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-default-certificate\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.879620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-stats-auth\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.879912 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:30.879641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:31.379615833 +0000 UTC m=+37.164841685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:30.879912 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-config\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.879912 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.879712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.879912 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:30.879807 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:31.379795758 +0000 UTC m=+37.165021592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:30.880542 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.880516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-config\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.882447 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.882395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.882619 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.882596 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-stats-auth\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.882711 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.882690 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-default-certificate\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.894256 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.894185 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7scm\" (UniqueName: \"kubernetes.io/projected/e4f9ffa0-361b-4167-9ee3-0a7ac08e5162-kube-api-access-q7scm\") pod \"service-ca-operator-5d46d9ffd4-gmpx6\" (UID: \"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:30.896262 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.896237 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98bk\" (UniqueName: \"kubernetes.io/projected/669b326b-1e71-4f5b-ac30-d2174600185d-kube-api-access-m98bk\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:30.950139 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:30.950085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" Jul 02 21:19:31.182321 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.182231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:31.182481 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:31.182419 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:31.182533 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:31.182522 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:32.182496248 +0000 UTC m=+37.967722086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:31.384273 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.384234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:31.384471 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:31.384355 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:31.384471 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.384389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:31.384471 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:31.384453 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:32.384434569 +0000 UTC m=+38.169660412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:31.384634 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:31.384494 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:32.384484462 +0000 UTC m=+38.169710295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:31.756287 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.756252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:31.756287 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.756275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:31.756579 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.756275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:31.759620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.759376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zt75x\"" Jul 02 21:19:31.759620 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.759445 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:19:31.760230 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.760209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:19:31.760340 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.760317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:19:31.760391 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.760341 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zvz49\"" Jul 02 21:19:31.760435 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:31.760421 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:19:32.191346 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.191306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:32.191853 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:32.191507 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:32.191853 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:32.191617 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.191596053 +0000 UTC m=+39.976821901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:32.395303 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.394717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:32.395700 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:32.395319 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.39525522 +0000 UTC m=+40.180481057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:32.395700 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.395382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:32.395700 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:32.395543 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:32.395700 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:32.395624 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:34.395608769 +0000 UTC m=+40.180834625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:32.452016 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.451989 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bwl8z"] Jul 02 21:19:32.455330 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:32.455304 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc178907_cf96_496a_8858_a535e8c08dab.slice/crio-4e859f2ec65d55244825dd85c8b920a089ba4724a08557caedb7299d15934c37 WatchSource:0}: Error finding container 4e859f2ec65d55244825dd85c8b920a089ba4724a08557caedb7299d15934c37: Status 404 returned error can't find the container with id 4e859f2ec65d55244825dd85c8b920a089ba4724a08557caedb7299d15934c37 Jul 02 21:19:32.461236 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.461209 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6"] Jul 02 21:19:32.464920 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:32.464894 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvgx8"] Jul 02 21:19:32.465707 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:32.465583 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f9ffa0_361b_4167_9ee3_0a7ac08e5162.slice/crio-885ade7a25afd10fe82341687cdc2d39e1b709e6260a33c78479eb8c17e3fab9 WatchSource:0}: Error finding container 885ade7a25afd10fe82341687cdc2d39e1b709e6260a33c78479eb8c17e3fab9: Status 404 returned error can't find the container with id 885ade7a25afd10fe82341687cdc2d39e1b709e6260a33c78479eb8c17e3fab9 Jul 02 21:19:32.468475 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:32.468448 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25ef769_f55b_4956_b3c1_cd0956c81a20.slice/crio-37fa549d2db1509de4a005f5818f229f7a4c2434f60204a22d71d02935003807 WatchSource:0}: Error finding container 37fa549d2db1509de4a005f5818f229f7a4c2434f60204a22d71d02935003807: Status 404 returned error can't find the container with id 37fa549d2db1509de4a005f5818f229f7a4c2434f60204a22d71d02935003807 Jul 02 21:19:33.139383 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:33.139212 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="30bf69757a553a908f6966429cd9c68d5557be25c974c70fe4225db21e1a328d" exitCode=0 Jul 02 21:19:33.139383 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:33.139324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"30bf69757a553a908f6966429cd9c68d5557be25c974c70fe4225db21e1a328d"} Jul 02 21:19:33.154795 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:33.154759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" event={"ID":"cc178907-cf96-496a-8858-a535e8c08dab","Type":"ContainerStarted","Data":"4e859f2ec65d55244825dd85c8b920a089ba4724a08557caedb7299d15934c37"} Jul 02 21:19:33.158006 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:33.157683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvgx8" event={"ID":"d25ef769-f55b-4956-b3c1-cd0956c81a20","Type":"ContainerStarted","Data":"37fa549d2db1509de4a005f5818f229f7a4c2434f60204a22d71d02935003807"} Jul 02 21:19:33.160665 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:33.160623 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" event={"ID":"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162","Type":"ContainerStarted","Data":"885ade7a25afd10fe82341687cdc2d39e1b709e6260a33c78479eb8c17e3fab9"} Jul 02 21:19:34.168475 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.168403 2580 generic.go:356] "Generic (PLEG): container finished" podID="348541db-0e6f-4049-9504-e86f371cfe87" containerID="659f9b59d43908e3476537d7137189899d3c0f75788f8dc909b64ea4798e7b54" exitCode=0 Jul 02 21:19:34.169115 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.168496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerDied","Data":"659f9b59d43908e3476537d7137189899d3c0f75788f8dc909b64ea4798e7b54"} Jul 02 21:19:34.214422 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.213756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:34.214422 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:34.213995 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:34.214422 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:34.214065 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.214047341 +0000 UTC m=+43.999273180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:34.415789 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.415736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:34.415789 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.415785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:34.415989 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:34.415893 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:34.415989 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:34.415922 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.415902531 +0000 UTC m=+44.201128374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:34.415989 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:34.415944 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.415934368 +0000 UTC m=+44.201160209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:34.584214 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.584137 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt"] Jul 02 21:19:34.605194 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.605160 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt"] Jul 02 21:19:34.605352 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.605291 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" Jul 02 21:19:34.610272 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.610236 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:34.610814 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.610793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 21:19:34.611068 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.611048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wbdxz\"" Jul 02 21:19:34.718548 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.718511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkc6\" (UniqueName: \"kubernetes.io/projected/831356ce-70d0-4ba1-9293-79be4b13d2f2-kube-api-access-wqkc6\") pod \"migrator-d57d58cc9-bs4xt\" (UID: \"831356ce-70d0-4ba1-9293-79be4b13d2f2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" Jul 02 21:19:34.819991 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.819940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkc6\" (UniqueName: \"kubernetes.io/projected/831356ce-70d0-4ba1-9293-79be4b13d2f2-kube-api-access-wqkc6\") pod \"migrator-d57d58cc9-bs4xt\" (UID: \"831356ce-70d0-4ba1-9293-79be4b13d2f2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" Jul 02 21:19:34.832699 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.832663 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkc6\" (UniqueName: \"kubernetes.io/projected/831356ce-70d0-4ba1-9293-79be4b13d2f2-kube-api-access-wqkc6\") pod \"migrator-d57d58cc9-bs4xt\" (UID: \"831356ce-70d0-4ba1-9293-79be4b13d2f2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" Jul 02 21:19:34.915313 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:34.915275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" Jul 02 21:19:36.787316 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:36.787292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt"] Jul 02 21:19:36.803106 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:36.803080 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831356ce_70d0_4ba1_9293_79be4b13d2f2.slice/crio-d077b170867f3b7cf8b37e354dc8dfeefbf86de0ce1549c8d686005b1421466e WatchSource:0}: Error finding container d077b170867f3b7cf8b37e354dc8dfeefbf86de0ce1549c8d686005b1421466e: Status 404 returned error can't find the container with id d077b170867f3b7cf8b37e354dc8dfeefbf86de0ce1549c8d686005b1421466e Jul 02 21:19:37.179429 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.179393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vftx7" event={"ID":"348541db-0e6f-4049-9504-e86f371cfe87","Type":"ContainerStarted","Data":"815645d645510f173299f91eb0f0f8567089b6e5a5abf4a92a53b819f65daf8a"} Jul 02 21:19:37.180728 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.180700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" event={"ID":"831356ce-70d0-4ba1-9293-79be4b13d2f2","Type":"ContainerStarted","Data":"d077b170867f3b7cf8b37e354dc8dfeefbf86de0ce1549c8d686005b1421466e"} Jul 02 21:19:37.182096 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.182074 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" event={"ID":"cc178907-cf96-496a-8858-a535e8c08dab","Type":"ContainerStarted","Data":"acf4b372dde940d659b8e5c73543aea05b03093108e354a0d6af5c496c704134"} Jul 02 21:19:37.183599 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.183572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" event={"ID":"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162","Type":"ContainerStarted","Data":"db01c6270b8cef495172e5127d074586caab44bd9e61d847b5d99782440cdd3b"} Jul 02 21:19:37.185115 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.185093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvgx8" event={"ID":"d25ef769-f55b-4956-b3c1-cd0956c81a20","Type":"ContainerStarted","Data":"b66eda8556fe02da3a49e2de4931cb5f1af17494d694f653bb83652f33a9f111"} Jul 02 21:19:37.205362 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.205300 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vftx7" podStartSLOduration=9.732851984 podStartE2EDuration="42.205278579s" totalImagesPullingTime="32.472426595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:37.204211204 +0000 UTC m=+42.989437060" watchObservedRunningTime="2026-07-02 21:19:37.205278579 +0000 UTC m=+42.990504434" Jul 02 21:19:37.223402 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.223348 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dvgx8" podStartSLOduration=3.078558095 podStartE2EDuration="7.223331351s" totalImagesPullingTime="4.144773256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:37.222075302 +0000 UTC m=+43.007301169" watchObservedRunningTime="2026-07-02 21:19:37.223331351 +0000 UTC m=+43.008557207" Jul 02 21:19:37.240989 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.240924 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" podStartSLOduration=3.089454064 podStartE2EDuration="7.240904128s" totalImagesPullingTime="4.151450064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:37.240790595 +0000 UTC m=+43.026016451" watchObservedRunningTime="2026-07-02 21:19:37.240904128 +0000 UTC m=+43.026129981" Jul 02 21:19:37.262860 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.262797 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" podStartSLOduration=3.104872682 podStartE2EDuration="7.26278012s" totalImagesPullingTime="4.157907438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:37.261079508 +0000 UTC m=+43.046305361" watchObservedRunningTime="2026-07-02 21:19:37.26278012 +0000 UTC m=+43.048005978" Jul 02 21:19:37.959612 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.959543 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m6bc9"] Jul 02 21:19:37.977972 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.977932 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6bc9"] Jul 02 21:19:37.978136 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.978059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:37.980743 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.980703 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 21:19:37.980886 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.980739 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4mjq\"" Jul 02 21:19:37.980886 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:37.980747 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 21:19:38.148925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.148886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2xr8\" (UniqueName: \"kubernetes.io/projected/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-api-access-s2xr8\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.149113 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.148954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec824c1-7384-4c3b-a0b4-933c4b8872b1-data-volume\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.149113 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.148985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.149113 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.149057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.149113 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.149107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec824c1-7384-4c3b-a0b4-933c4b8872b1-crio-socket\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.249730 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.249648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:38.249863 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.249732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2xr8\" (UniqueName: \"kubernetes.io/projected/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-api-access-s2xr8\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.249863 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.249770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec824c1-7384-4c3b-a0b4-933c4b8872b1-data-volume\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.249863 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.249790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.249863 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.249815 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:38.249863 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.249864 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:38.250063 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.249891 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:46.249870849 +0000 UTC m=+52.035096687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:38.250063 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.249962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.250063 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.250015 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.749999035 +0000 UTC m=+44.535224889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:38.250063 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.250039 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:38.250063 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.250042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec824c1-7384-4c3b-a0b4-933c4b8872b1-crio-socket\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.250229 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.250098 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:38.750083391 +0000 UTC m=+44.535309226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : configmap "kube-rbac-proxy" not found Jul 02 21:19:38.250229 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.250154 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec824c1-7384-4c3b-a0b4-933c4b8872b1-crio-socket\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.250229 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.250155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec824c1-7384-4c3b-a0b4-933c4b8872b1-data-volume\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.259237 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.259202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2xr8\" (UniqueName: \"kubernetes.io/projected/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-api-access-s2xr8\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.451964 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.451932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:38.452115 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.452041 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:38.452115 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.452064 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:38.452194 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.452132 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:46.452116417 +0000 UTC m=+52.237342250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:38.452194 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.452153 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:19:46.452142054 +0000 UTC m=+52.237367887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:38.754716 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.754678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.754716 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:38.754723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:38.754913 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.754786 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:38.754913 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.754810 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:38.754913 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.754836 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:39.754823063 +0000 UTC m=+45.540048896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : configmap "kube-rbac-proxy" not found Jul 02 21:19:38.754913 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:38.754887 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:39.754874171 +0000 UTC m=+45.540100009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:39.193988 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.193957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" event={"ID":"831356ce-70d0-4ba1-9293-79be4b13d2f2","Type":"ContainerStarted","Data":"307bfb0baf206136316c5441b2a4baadf12fccc9fb83406e4a8adf6fa972fb5b"} Jul 02 21:19:39.194359 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.194006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" event={"ID":"831356ce-70d0-4ba1-9293-79be4b13d2f2","Type":"ContainerStarted","Data":"f0d409654b9b6f3a7624188ffd339ce920f456c50535478aa08e186aba2dbb90"} Jul 02 21:19:39.210261 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.210203 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bs4xt" podStartSLOduration=3.40885409 podStartE2EDuration="5.210187404s" totalImagesPullingTime="1.801333314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:39.209338259 +0000 UTC m=+44.994564135" watchObservedRunningTime="2026-07-02 21:19:39.210187404 +0000 UTC m=+44.995413278" Jul 02 21:19:39.765220 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.765186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:39.765370 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.765245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:39.765370 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:39.765340 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:39.765454 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:39.765413 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:41.76539655 +0000 UTC m=+47.550622386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:39.765917 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:39.765896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec824c1-7384-4c3b-a0b4-933c4b8872b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:40.549148 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:40.549123 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48nnv_4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde/dns-node-resolver/0.log" Jul 02 21:19:41.784147 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:41.784106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:41.784675 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:41.784271 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:41.784675 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:41.784344 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:45.784328651 +0000 UTC m=+51.569554485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:41.949448 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:41.949420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvvtt_f77ee42a-d401-43a7-ab64-aa6fda52b1f7/node-ca/0.log" Jul 02 21:19:42.749582 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:42.749529 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvgx8_d25ef769-f55b-4956-b3c1-cd0956c81a20/serve-healthcheck-canary/0.log" Jul 02 21:19:42.948871 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:42.948841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bs4xt_831356ce-70d0-4ba1-9293-79be4b13d2f2/migrator/0.log" Jul 02 21:19:43.149240 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:43.149209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bs4xt_831356ce-70d0-4ba1-9293-79be4b13d2f2/graceful-termination/0.log" Jul 02 21:19:45.817690 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:45.817651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:45.818088 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:45.817811 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:45.818088 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:45.817884 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls podName:cec824c1-7384-4c3b-a0b4-933c4b8872b1 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:53.817868011 +0000 UTC m=+59.603093849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m6bc9" (UID: "cec824c1-7384-4c3b-a0b4-933c4b8872b1") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:46.322198 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:46.322156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:19:46.322371 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:46.322311 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:46.322412 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:46.322378 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls podName:7414621c-2028-4391-b804-51558b21d753 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.322363467 +0000 UTC m=+68.107589302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls") pod "dns-default-mz5ml" (UID: "7414621c-2028-4391-b804-51558b21d753") : secret "dns-default-metrics-tls" not found Jul 02 21:19:46.524303 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:46.524265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:46.524303 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:46.524318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:19:46.524515 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:46.524447 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.524427867 +0000 UTC m=+68.309653702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : configmap references non-existent config key: service-ca.crt Jul 02 21:19:46.524515 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:46.524454 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 21:19:46.524515 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:19:46.524496 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs podName:669b326b-1e71-4f5b-ac30-d2174600185d nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.524485442 +0000 UTC m=+68.309711276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs") pod "router-default-55cc8f7f95-rp5gk" (UID: "669b326b-1e71-4f5b-ac30-d2174600185d") : secret "router-metrics-certs-default" not found Jul 02 21:19:53.878960 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:53.878918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:53.881439 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:53.881410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec824c1-7384-4c3b-a0b4-933c4b8872b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6bc9\" (UID: \"cec824c1-7384-4c3b-a0b4-933c4b8872b1\") " pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:53.889358 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:53.889325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6bc9" Jul 02 21:19:54.020619 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:54.020588 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6bc9"] Jul 02 21:19:54.023758 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:54.023733 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec824c1_7384_4c3b_a0b4_933c4b8872b1.slice/crio-dda80da180c5116b167413b1fe2aa417a5b297fdff7c471f490b23e6f5877ac2 WatchSource:0}: Error finding container dda80da180c5116b167413b1fe2aa417a5b297fdff7c471f490b23e6f5877ac2: Status 404 returned error can't find the container with id dda80da180c5116b167413b1fe2aa417a5b297fdff7c471f490b23e6f5877ac2 Jul 02 21:19:54.242733 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:54.242632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6bc9" event={"ID":"cec824c1-7384-4c3b-a0b4-933c4b8872b1","Type":"ContainerStarted","Data":"dda80da180c5116b167413b1fe2aa417a5b297fdff7c471f490b23e6f5877ac2"} Jul 02 21:19:57.132651 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:57.132616 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gz4j" Jul 02 21:19:58.257714 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:58.257677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6bc9" event={"ID":"cec824c1-7384-4c3b-a0b4-933c4b8872b1","Type":"ContainerStarted","Data":"dd13145ac54fc934d3d066ce1c01d1d76826ede618ea106ffffbb8302a294224"} Jul 02 21:19:59.262484 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.262438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6bc9" event={"ID":"cec824c1-7384-4c3b-a0b4-933c4b8872b1","Type":"ContainerStarted","Data":"68a4afe406eaec61b9c50e7f286f59ebca9dadc7108d04b2eab9b5f29e1f585a"} Jul 02 21:19:59.528334 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.528246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:59.528505 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.528364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:59.531143 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.531106 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:19:59.531143 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.531106 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:19:59.542105 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.542072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bd1f137-236c-40e6-a679-77e03159e3c9-original-pull-secret\") pod \"global-pull-secret-syncer-x2wx7\" (UID: \"8bd1f137-236c-40e6-a679-77e03159e3c9\") " pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:59.542280 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.542259 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4378b38-ddf0-4880-9256-44d68159e682-metrics-certs\") pod \"network-metrics-daemon-l8mj5\" (UID: \"e4378b38-ddf0-4880-9256-44d68159e682\") " pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:59.629143 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.629099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:59.632186 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.632152 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:19:59.643790 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.643755 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:19:59.653301 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.653257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf552\" (UniqueName: \"kubernetes.io/projected/f2f32bda-dd1a-4906-b905-9f2a0765e1f8-kube-api-access-qf552\") pod \"network-check-target-p5c6h\" (UID: \"f2f32bda-dd1a-4906-b905-9f2a0765e1f8\") " pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:59.672893 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.672847 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zvz49\"" Jul 02 21:19:59.676451 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.676421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2wx7" Jul 02 21:19:59.680573 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.680536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8mj5" Jul 02 21:19:59.684808 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.684770 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zt75x\"" Jul 02 21:19:59.692039 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.692012 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:19:59.846051 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.846004 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2wx7"] Jul 02 21:19:59.850390 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:59.850346 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd1f137_236c_40e6_a679_77e03159e3c9.slice/crio-801eb0c3f9f6bebb5f0c493df54112895c1d8a4b8dbabce612984395954db4f3 WatchSource:0}: Error finding container 801eb0c3f9f6bebb5f0c493df54112895c1d8a4b8dbabce612984395954db4f3: Status 404 returned error can't find the container with id 801eb0c3f9f6bebb5f0c493df54112895c1d8a4b8dbabce612984395954db4f3 Jul 02 21:19:59.867321 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:19:59.867287 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5c6h"] Jul 02 21:19:59.870574 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:19:59.870526 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f32bda_dd1a_4906_b905_9f2a0765e1f8.slice/crio-a4e2e6628236817824ae46c7a1f025f9421c82a52eb263c76f14e28fc0269433 WatchSource:0}: Error finding container a4e2e6628236817824ae46c7a1f025f9421c82a52eb263c76f14e28fc0269433: Status 404 returned error can't find the container with id a4e2e6628236817824ae46c7a1f025f9421c82a52eb263c76f14e28fc0269433 Jul 02 21:20:00.071098 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:00.071023 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8mj5"] Jul 02 21:20:00.074731 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:20:00.074697 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4378b38_ddf0_4880_9256_44d68159e682.slice/crio-854e915beebad08205181d7b53386d94ce088e0bf06b1bef07c0848cf962cde9 WatchSource:0}: Error finding container 854e915beebad08205181d7b53386d94ce088e0bf06b1bef07c0848cf962cde9: Status 404 returned error can't find the container with id 854e915beebad08205181d7b53386d94ce088e0bf06b1bef07c0848cf962cde9 Jul 02 21:20:00.268149 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:00.268099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5c6h" event={"ID":"f2f32bda-dd1a-4906-b905-9f2a0765e1f8","Type":"ContainerStarted","Data":"a4e2e6628236817824ae46c7a1f025f9421c82a52eb263c76f14e28fc0269433"} Jul 02 21:20:00.269445 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:00.269414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8mj5" event={"ID":"e4378b38-ddf0-4880-9256-44d68159e682","Type":"ContainerStarted","Data":"854e915beebad08205181d7b53386d94ce088e0bf06b1bef07c0848cf962cde9"} Jul 02 21:20:00.270706 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:00.270680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2wx7" event={"ID":"8bd1f137-236c-40e6-a679-77e03159e3c9","Type":"ContainerStarted","Data":"801eb0c3f9f6bebb5f0c493df54112895c1d8a4b8dbabce612984395954db4f3"} Jul 02 21:20:02.280781 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.280736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6bc9" event={"ID":"cec824c1-7384-4c3b-a0b4-933c4b8872b1","Type":"ContainerStarted","Data":"3494d4176c4528622903e6882ebcd97c7fb71c62a7ad59941bbb94bfc86f2192"} Jul 02 21:20:02.307882 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.307819 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m6bc9" podStartSLOduration=17.914077177 podStartE2EDuration="25.307793351s" totalImagesPullingTime="7.393716174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:02.304804194 +0000 UTC m=+68.090030051" watchObservedRunningTime="2026-07-02 21:20:02.307793351 +0000 UTC m=+68.093019211" Jul 02 21:20:02.353683 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.353219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:20:02.356449 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.356418 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7414621c-2028-4391-b804-51558b21d753-metrics-tls\") pod \"dns-default-mz5ml\" (UID: \"7414621c-2028-4391-b804-51558b21d753\") " pod="openshift-dns/dns-default-mz5ml" Jul 02 21:20:02.554955 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.554860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:02.555133 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.554965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:02.555645 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.555620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669b326b-1e71-4f5b-ac30-d2174600185d-service-ca-bundle\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:02.558047 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.558019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/669b326b-1e71-4f5b-ac30-d2174600185d-metrics-certs\") pod \"router-default-55cc8f7f95-rp5gk\" (UID: \"669b326b-1e71-4f5b-ac30-d2174600185d\") " pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:02.634092 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.634058 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs2b2\"" Jul 02 21:20:02.640823 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.640790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz5ml" Jul 02 21:20:02.761751 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.761719 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z9bsj\"" Jul 02 21:20:02.769249 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:02.769209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:03.144093 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.142900 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc"] Jul 02 21:20:03.155730 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.155697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.162902 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.162855 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 21:20:03.163075 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.162913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 21:20:03.163848 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.163828 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 21:20:03.163961 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.163828 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 21:20:03.165333 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.165316 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 21:20:03.165758 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.165550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 21:20:03.165946 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.165917 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 21:20:03.202363 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.202332 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc"] Jul 02 21:20:03.260577 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.260767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.260767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.260767 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.260928 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjq9\" (UniqueName: \"kubernetes.io/projected/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-kube-api-access-9jjq9\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.260928 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.260835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362241 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362734 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362734 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362734 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362734 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.362734 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.362596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjq9\" (UniqueName: \"kubernetes.io/projected/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-kube-api-access-9jjq9\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.363832 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.363803 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.365328 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.365301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.365535 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.365511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.365612 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.365594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-ca\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.365853 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.365826 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-hub\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.443184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.443100 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjq9\" (UniqueName: \"kubernetes.io/projected/ea285c9f-e0ae-499d-bed2-4e35e06c4aaa-kube-api-access-9jjq9\") pod \"cluster-proxy-proxy-agent-d476bcf5-tclmc\" (UID: \"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.473970 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.473939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" Jul 02 21:20:03.841182 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:03.841148 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz5ml"] Jul 02 21:20:04.074899 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:04.074869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cc8f7f95-rp5gk"] Jul 02 21:20:04.086365 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:04.086335 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc"] Jul 02 21:20:05.184867 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:20:05.184826 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7414621c_2028_4391_b804_51558b21d753.slice/crio-2cd1cb5f178ef54a560a6324b66559f9f4734959c543915eebf3990c412b3f19 WatchSource:0}: Error finding container 2cd1cb5f178ef54a560a6324b66559f9f4734959c543915eebf3990c412b3f19: Status 404 returned error can't find the container with id 2cd1cb5f178ef54a560a6324b66559f9f4734959c543915eebf3990c412b3f19 Jul 02 21:20:05.185473 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:20:05.185437 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669b326b_1e71_4f5b_ac30_d2174600185d.slice/crio-7ac1874ea6ee35e7e3d67314eb28cca3f47b270aac07ae6c5b358baf98d5dd3a WatchSource:0}: Error finding container 7ac1874ea6ee35e7e3d67314eb28cca3f47b270aac07ae6c5b358baf98d5dd3a: Status 404 returned error can't find the container with id 7ac1874ea6ee35e7e3d67314eb28cca3f47b270aac07ae6c5b358baf98d5dd3a Jul 02 21:20:05.186347 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:20:05.186322 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea285c9f_e0ae_499d_bed2_4e35e06c4aaa.slice/crio-d233781b37faa170eef3400c6444ac7655fd9fd370f0fbae6ffdea34d95a8e53 WatchSource:0}: Error finding container d233781b37faa170eef3400c6444ac7655fd9fd370f0fbae6ffdea34d95a8e53: Status 404 returned error can't find the container with id d233781b37faa170eef3400c6444ac7655fd9fd370f0fbae6ffdea34d95a8e53 Jul 02 21:20:05.294639 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:05.294599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" event={"ID":"669b326b-1e71-4f5b-ac30-d2174600185d","Type":"ContainerStarted","Data":"7ac1874ea6ee35e7e3d67314eb28cca3f47b270aac07ae6c5b358baf98d5dd3a"} Jul 02 21:20:05.298168 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:05.298134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5ml" event={"ID":"7414621c-2028-4391-b804-51558b21d753","Type":"ContainerStarted","Data":"2cd1cb5f178ef54a560a6324b66559f9f4734959c543915eebf3990c412b3f19"} Jul 02 21:20:05.300873 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:05.300844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" event={"ID":"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa","Type":"ContainerStarted","Data":"d233781b37faa170eef3400c6444ac7655fd9fd370f0fbae6ffdea34d95a8e53"} Jul 02 21:20:06.307899 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.307846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8mj5" event={"ID":"e4378b38-ddf0-4880-9256-44d68159e682","Type":"ContainerStarted","Data":"982b368b758a5f1f56f7ae84deeb75254fc39fa746db0ff274f9b54ed9d920c7"} Jul 02 21:20:06.308342 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.307924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8mj5" event={"ID":"e4378b38-ddf0-4880-9256-44d68159e682","Type":"ContainerStarted","Data":"00622760adccd4245df27dc786b9373f0c98c11eb9cf93190ea5afe1657b0127"} Jul 02 21:20:06.310639 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.310590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2wx7" event={"ID":"8bd1f137-236c-40e6-a679-77e03159e3c9","Type":"ContainerStarted","Data":"8dfa7ed53af0476f1b1ced1be130bb424ddaf0324407e3fd25848a758c8dc70d"} Jul 02 21:20:06.312656 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.312628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5c6h" event={"ID":"f2f32bda-dd1a-4906-b905-9f2a0765e1f8","Type":"ContainerStarted","Data":"f1714948afb2b2a8d598729fe8f784303ac30764d54f6fa34175fe68da25ab4e"} Jul 02 21:20:06.313077 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.313058 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:20:06.314964 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.314910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" event={"ID":"669b326b-1e71-4f5b-ac30-d2174600185d","Type":"ContainerStarted","Data":"1e848afcae9279ce3f4662f9925a3e71946db8fb65cedb844a179e412d9ecd3d"} Jul 02 21:20:06.334462 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.334389 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l8mj5" podStartSLOduration=67.777165746 podStartE2EDuration="1m11.334366496s" totalImagesPullingTime="3.55720075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:06.333143243 +0000 UTC m=+72.118369120" watchObservedRunningTime="2026-07-02 21:20:06.334366496 +0000 UTC m=+72.119592355" Jul 02 21:20:06.459052 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.458976 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p5c6h" podStartSLOduration=67.698197799 podStartE2EDuration="1m11.458952331s" totalImagesPullingTime="3.760754532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:06.458705707 +0000 UTC m=+72.243931575" watchObservedRunningTime="2026-07-02 21:20:06.458952331 +0000 UTC m=+72.244178189" Jul 02 21:20:06.459219 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.459185 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" podStartSLOduration=36.45917439 podStartE2EDuration="36.45917439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:06.414973732 +0000 UTC m=+72.200199598" watchObservedRunningTime="2026-07-02 21:20:06.45917439 +0000 UTC m=+72.244400247" Jul 02 21:20:06.480598 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.480515 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x2wx7" podStartSLOduration=65.737093485 podStartE2EDuration="1m11.480491576s" totalImagesPullingTime="5.743398091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:06.478947611 +0000 UTC m=+72.264173491" watchObservedRunningTime="2026-07-02 21:20:06.480491576 +0000 UTC m=+72.265717412" Jul 02 21:20:06.770494 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.770446 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:06.773700 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:06.773667 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:07.319742 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:07.319715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:07.321098 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:07.321075 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55cc8f7f95-rp5gk" Jul 02 21:20:09.328933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.328821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5ml" event={"ID":"7414621c-2028-4391-b804-51558b21d753","Type":"ContainerStarted","Data":"98720e5abb465f813ba68425bf14e782c63f688d8a98bab7a36edc3d5d6a1040"} Jul 02 21:20:09.328933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.328889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5ml" event={"ID":"7414621c-2028-4391-b804-51558b21d753","Type":"ContainerStarted","Data":"05ded4243c6669789945f3c5b7f738a7ef3e4e3bf33464768c7868f33735da16"} Jul 02 21:20:09.329391 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.328938 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mz5ml" Jul 02 21:20:09.330952 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.330928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" event={"ID":"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa","Type":"ContainerStarted","Data":"7df4a85361690a8a7a2745c5b8990bf6af249ed116a7041e4ce06e4866764f8d"} Jul 02 21:20:09.331088 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.330964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" event={"ID":"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa","Type":"ContainerStarted","Data":"4ff4fbf5efe31ca618f503330ea1fd19e66b73e07806665553dac45fcd60cfb8"} Jul 02 21:20:09.331088 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.330975 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" event={"ID":"ea285c9f-e0ae-499d-bed2-4e35e06c4aaa","Type":"ContainerStarted","Data":"4833f93feee09cec93026a67978f6475f7e249cace70386b2a3e8ef02e4ffe02"} Jul 02 21:20:09.365629 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.365572 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mz5ml" podStartSLOduration=36.671735732 podStartE2EDuration="39.365536596s" totalImagesPullingTime="2.693800864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:09.364476179 +0000 UTC m=+75.149702054" watchObservedRunningTime="2026-07-02 21:20:09.365536596 +0000 UTC m=+75.150762497" Jul 02 21:20:09.406801 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:09.406748 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d476bcf5-tclmc" podStartSLOduration=2.547746708 podStartE2EDuration="6.406729331s" totalImagesPullingTime="3.858982623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:09.404045431 +0000 UTC m=+75.189271287" watchObservedRunningTime="2026-07-02 21:20:09.406729331 +0000 UTC m=+75.191955186" Jul 02 21:20:16.140360 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.140235 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8r2tk"] Jul 02 21:20:16.142589 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.142549 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.147240 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.147214 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 21:20:16.148281 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 21:20:16.148405 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148281 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 21:20:16.148405 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148263 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nqfz6\"" Jul 02 21:20:16.148405 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148388 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 21:20:16.148405 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148396 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 21:20:16.148963 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.148940 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 21:20:16.275933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.275892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-metrics-client-ca\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.275933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.275931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.275953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-sys\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.275969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.276075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-root\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.276104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.276125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-textfile\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.276161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-wtmp\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.276359 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.276187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ddws\" (UniqueName: \"kubernetes.io/projected/9013a7c8-b939-49e5-8c80-e89d30b8b97d-kube-api-access-2ddws\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377148 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-metrics-client-ca\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377148 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-sys\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-root\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-sys\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-textfile\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-root\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:20:16.377357 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 21:20:16.377397 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-wtmp\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377773 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ddws\" (UniqueName: \"kubernetes.io/projected/9013a7c8-b939-49e5-8c80-e89d30b8b97d-kube-api-access-2ddws\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377773 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:20:16.377432 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls podName:9013a7c8-b939-49e5-8c80-e89d30b8b97d nodeName:}" failed. No retries permitted until 2026-07-02 21:20:16.877410476 +0000 UTC m=+82.662636311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls") pod "node-exporter-8r2tk" (UID: "9013a7c8-b939-49e5-8c80-e89d30b8b97d") : secret "node-exporter-tls" not found Jul 02 21:20:16.377773 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377584 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-wtmp\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377773 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377687 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-textfile\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377912 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-metrics-client-ca\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.377912 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.377862 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.379714 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.379696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.386170 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.386147 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ddws\" (UniqueName: \"kubernetes.io/projected/9013a7c8-b939-49e5-8c80-e89d30b8b97d-kube-api-access-2ddws\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.886360 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.886321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:16.888940 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:16.888912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9013a7c8-b939-49e5-8c80-e89d30b8b97d-node-exporter-tls\") pod \"node-exporter-8r2tk\" (UID: \"9013a7c8-b939-49e5-8c80-e89d30b8b97d\") " pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:17.051706 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:17.051668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8r2tk" Jul 02 21:20:17.063771 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:20:17.063738 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9013a7c8_b939_49e5_8c80_e89d30b8b97d.slice/crio-8615a8c815a5db54d0c17097aad4af4e4b1f481cb1f4f9cb34082cc32c37f770 WatchSource:0}: Error finding container 8615a8c815a5db54d0c17097aad4af4e4b1f481cb1f4f9cb34082cc32c37f770: Status 404 returned error can't find the container with id 8615a8c815a5db54d0c17097aad4af4e4b1f481cb1f4f9cb34082cc32c37f770 Jul 02 21:20:17.361254 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:17.361132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8r2tk" event={"ID":"9013a7c8-b939-49e5-8c80-e89d30b8b97d","Type":"ContainerStarted","Data":"8615a8c815a5db54d0c17097aad4af4e4b1f481cb1f4f9cb34082cc32c37f770"} Jul 02 21:20:18.366374 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:18.366337 2580 generic.go:356] "Generic (PLEG): container finished" podID="9013a7c8-b939-49e5-8c80-e89d30b8b97d" containerID="27b2532458d31c357ce178e6fdd5285f2b68c2e0740c5835cd902cde63f91e6d" exitCode=0 Jul 02 21:20:18.366862 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:18.366440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8r2tk" event={"ID":"9013a7c8-b939-49e5-8c80-e89d30b8b97d","Type":"ContainerDied","Data":"27b2532458d31c357ce178e6fdd5285f2b68c2e0740c5835cd902cde63f91e6d"} Jul 02 21:20:19.337255 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:19.337225 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mz5ml" Jul 02 21:20:19.371613 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:19.371579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8r2tk" event={"ID":"9013a7c8-b939-49e5-8c80-e89d30b8b97d","Type":"ContainerStarted","Data":"f0217c608b96803b288777226e65efa84ebd2c88bb4fc472beb16fd10640f856"} Jul 02 21:20:19.371978 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:19.371632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8r2tk" event={"ID":"9013a7c8-b939-49e5-8c80-e89d30b8b97d","Type":"ContainerStarted","Data":"1de4044e330bc33e3ab7e09933cd96ff82c46102a175082cc77ca55d5b2fc355"} Jul 02 21:20:19.396107 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:19.396049 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8r2tk" podStartSLOduration=2.43640214 podStartE2EDuration="3.396030971s" totalImagesPullingTime="884.735213ms" totalInitContainerRuntime="74.893618ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:19.394370685 +0000 UTC m=+85.179596565" watchObservedRunningTime="2026-07-02 21:20:19.396030971 +0000 UTC m=+85.181256826" Jul 02 21:20:38.326041 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:20:38.326004 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p5c6h" Jul 02 21:21:07.534324 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:07.534288 2580 generic.go:356] "Generic (PLEG): container finished" podID="cc178907-cf96-496a-8858-a535e8c08dab" containerID="acf4b372dde940d659b8e5c73543aea05b03093108e354a0d6af5c496c704134" exitCode=0 Jul 02 21:21:07.534783 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:07.534362 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" event={"ID":"cc178907-cf96-496a-8858-a535e8c08dab","Type":"ContainerDied","Data":"acf4b372dde940d659b8e5c73543aea05b03093108e354a0d6af5c496c704134"} Jul 02 21:21:07.534825 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:07.534799 2580 scope.go:117] "RemoveContainer" containerID="acf4b372dde940d659b8e5c73543aea05b03093108e354a0d6af5c496c704134" Jul 02 21:21:08.539677 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:08.539641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bwl8z" event={"ID":"cc178907-cf96-496a-8858-a535e8c08dab","Type":"ContainerStarted","Data":"b4627b531b1f241a0bdb2e0bb6b88a3774de11f85ccce181cbf187a57e081594"} Jul 02 21:21:08.541050 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:08.541027 2580 generic.go:356] "Generic (PLEG): container finished" podID="e4f9ffa0-361b-4167-9ee3-0a7ac08e5162" containerID="db01c6270b8cef495172e5127d074586caab44bd9e61d847b5d99782440cdd3b" exitCode=0 Jul 02 21:21:08.541186 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:08.541058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" event={"ID":"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162","Type":"ContainerDied","Data":"db01c6270b8cef495172e5127d074586caab44bd9e61d847b5d99782440cdd3b"} Jul 02 21:21:08.541344 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:08.541330 2580 scope.go:117] "RemoveContainer" containerID="db01c6270b8cef495172e5127d074586caab44bd9e61d847b5d99782440cdd3b" Jul 02 21:21:09.550782 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:21:09.550744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gmpx6" event={"ID":"e4f9ffa0-361b-4167-9ee3-0a7ac08e5162","Type":"ContainerStarted","Data":"0fcb5c003dd11badf83dab2d252e980c805c5b24e58840a65b64b9059bfaa044"} Jul 02 21:23:54.599269 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:23:54.599237 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:23:54.602592 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:23:54.602547 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 21:23:54.603409 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:23:54.603390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:24:13.507235 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.507194 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb"] Jul 02 21:24:13.509412 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.509392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.512043 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.512019 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 21:24:13.512169 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.512148 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ls8gp\"" Jul 02 21:24:13.513051 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.513032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 21:24:13.519148 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.519124 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb"] Jul 02 21:24:13.574906 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.574861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.575085 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.574922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jbz\" (UniqueName: \"kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.575085 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.575023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.675369 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.675333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jbz\" (UniqueName: \"kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.675512 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.675402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.675512 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.675420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.675812 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.675794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.675872 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.675831 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.685912 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.685887 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jbz\" (UniqueName: \"kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.818755 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.818658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:13.953732 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.953700 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb"] Jul 02 21:24:13.957043 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:24:13.957014 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776b55a0_52bf_4dba_87dc_050337a2e70e.slice/crio-4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7 WatchSource:0}: Error finding container 4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7: Status 404 returned error can't find the container with id 4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7 Jul 02 21:24:13.959009 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:13.958991 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:24:14.165275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:14.165241 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" event={"ID":"776b55a0-52bf-4dba-87dc-050337a2e70e","Type":"ContainerStarted","Data":"4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7"} Jul 02 21:24:21.196172 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:21.196134 2580 generic.go:356] "Generic (PLEG): container finished" podID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerID="510447c74774572b0a50297a3f4f2117783584fd4825039bfc0a16dbe6877687" exitCode=0 Jul 02 21:24:21.196588 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:21.196181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" event={"ID":"776b55a0-52bf-4dba-87dc-050337a2e70e","Type":"ContainerDied","Data":"510447c74774572b0a50297a3f4f2117783584fd4825039bfc0a16dbe6877687"} Jul 02 21:24:30.232012 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:30.231976 2580 generic.go:356] "Generic (PLEG): container finished" podID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerID="05aa597925fb59d403f70e3a00653d1bdef79103ee5bd1cd9debe44810406000" exitCode=0 Jul 02 21:24:30.232392 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:30.232018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" event={"ID":"776b55a0-52bf-4dba-87dc-050337a2e70e","Type":"ContainerDied","Data":"05aa597925fb59d403f70e3a00653d1bdef79103ee5bd1cd9debe44810406000"} Jul 02 21:24:38.263329 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:38.263298 2580 generic.go:356] "Generic (PLEG): container finished" podID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerID="eecc785e9c93e14893afe721e96bdd1c352786dae4c66fa5b97d9a4981390c8e" exitCode=0 Jul 02 21:24:38.263746 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:38.263353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" event={"ID":"776b55a0-52bf-4dba-87dc-050337a2e70e","Type":"ContainerDied","Data":"eecc785e9c93e14893afe721e96bdd1c352786dae4c66fa5b97d9a4981390c8e"} Jul 02 21:24:39.387339 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.387313 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:39.459883 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.459842 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle\") pod \"776b55a0-52bf-4dba-87dc-050337a2e70e\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " Jul 02 21:24:39.460080 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.459896 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util\") pod \"776b55a0-52bf-4dba-87dc-050337a2e70e\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " Jul 02 21:24:39.460080 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.459922 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89jbz\" (UniqueName: \"kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz\") pod \"776b55a0-52bf-4dba-87dc-050337a2e70e\" (UID: \"776b55a0-52bf-4dba-87dc-050337a2e70e\") " Jul 02 21:24:39.460492 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.460460 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle" (OuterVolumeSpecName: "bundle") pod "776b55a0-52bf-4dba-87dc-050337a2e70e" (UID: "776b55a0-52bf-4dba-87dc-050337a2e70e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:24:39.462342 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.462308 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz" (OuterVolumeSpecName: "kube-api-access-89jbz") pod "776b55a0-52bf-4dba-87dc-050337a2e70e" (UID: "776b55a0-52bf-4dba-87dc-050337a2e70e"). InnerVolumeSpecName "kube-api-access-89jbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:24:39.464836 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.464808 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util" (OuterVolumeSpecName: "util") pod "776b55a0-52bf-4dba-87dc-050337a2e70e" (UID: "776b55a0-52bf-4dba-87dc-050337a2e70e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:24:39.560852 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.560765 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:24:39.560852 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.560795 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/776b55a0-52bf-4dba-87dc-050337a2e70e-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:24:39.560852 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:39.560807 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89jbz\" (UniqueName: \"kubernetes.io/projected/776b55a0-52bf-4dba-87dc-050337a2e70e-kube-api-access-89jbz\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:24:40.271616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:40.271585 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" Jul 02 21:24:40.271616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:40.271598 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hrgjb" event={"ID":"776b55a0-52bf-4dba-87dc-050337a2e70e","Type":"ContainerDied","Data":"4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7"} Jul 02 21:24:40.271827 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:40.271653 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ab0fc346794e9d0ee64c5a989ccfa9ba737d64271207786dd532c5b5422b1b7" Jul 02 21:24:52.093063 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.092961 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-gkkjr"] Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093274 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="pull" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093291 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="pull" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093302 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="util" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093308 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="util" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093316 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="extract" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093321 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="extract" Jul 02 21:24:52.093866 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.093371 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="776b55a0-52bf-4dba-87dc-050337a2e70e" containerName="extract" Jul 02 21:24:52.095174 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.095157 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.098103 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.098076 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 02 21:24:52.098275 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.098124 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 02 21:24:52.099289 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.099265 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 02 21:24:52.099401 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.099265 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-2x4zm\"" Jul 02 21:24:52.099401 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.099309 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 02 21:24:52.108436 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.108409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-gkkjr"] Jul 02 21:24:52.155001 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.154960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bv9j\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-kube-api-access-8bv9j\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.155001 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.155003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.255880 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.255840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bv9j\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-kube-api-access-8bv9j\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.255880 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.255883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.256086 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.256007 2580 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 02 21:24:52.256086 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.256028 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-gkkjr: secret "keda-admission-webhooks-certs" not found Jul 02 21:24:52.256086 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.256081 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates podName:91dd2be8-843a-4e76-9d7c-8c87f85c0957 nodeName:}" failed. No retries permitted until 2026-07-02 21:24:52.756063908 +0000 UTC m=+358.541289743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates") pod "keda-admission-5fbd5c4644-gkkjr" (UID: "91dd2be8-843a-4e76-9d7c-8c87f85c0957") : secret "keda-admission-webhooks-certs" not found Jul 02 21:24:52.265121 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.265095 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bv9j\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-kube-api-access-8bv9j\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.760939 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:52.760898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:52.761113 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.761046 2580 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 02 21:24:52.761113 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.761068 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-gkkjr: secret "keda-admission-webhooks-certs" not found Jul 02 21:24:52.761181 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:24:52.761127 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates podName:91dd2be8-843a-4e76-9d7c-8c87f85c0957 nodeName:}" failed. No retries permitted until 2026-07-02 21:24:53.761112079 +0000 UTC m=+359.546337912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates") pod "keda-admission-5fbd5c4644-gkkjr" (UID: "91dd2be8-843a-4e76-9d7c-8c87f85c0957") : secret "keda-admission-webhooks-certs" not found Jul 02 21:24:53.769528 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:53.769484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:53.772134 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:53.772113 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/91dd2be8-843a-4e76-9d7c-8c87f85c0957-certificates\") pod \"keda-admission-5fbd5c4644-gkkjr\" (UID: \"91dd2be8-843a-4e76-9d7c-8c87f85c0957\") " pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:53.905127 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:53.905088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:54.038441 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:54.038256 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-gkkjr"] Jul 02 21:24:54.040941 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:24:54.040914 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91dd2be8_843a_4e76_9d7c_8c87f85c0957.slice/crio-6b506aa3bdf02d57c4dc06898b2e3ef2bf8b5a58a667575cd830ba4c62defba6 WatchSource:0}: Error finding container 6b506aa3bdf02d57c4dc06898b2e3ef2bf8b5a58a667575cd830ba4c62defba6: Status 404 returned error can't find the container with id 6b506aa3bdf02d57c4dc06898b2e3ef2bf8b5a58a667575cd830ba4c62defba6 Jul 02 21:24:54.325580 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:54.325473 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" event={"ID":"91dd2be8-843a-4e76-9d7c-8c87f85c0957","Type":"ContainerStarted","Data":"6b506aa3bdf02d57c4dc06898b2e3ef2bf8b5a58a667575cd830ba4c62defba6"} Jul 02 21:24:56.336008 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:56.335972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" event={"ID":"91dd2be8-843a-4e76-9d7c-8c87f85c0957","Type":"ContainerStarted","Data":"7b56f8e4d4f5b9f6f14a534d5f35481d6bb23b4d970130535aed6732246af4e9"} Jul 02 21:24:56.336413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:56.336093 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:24:56.354801 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:24:56.354749 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" podStartSLOduration=3.003836102 podStartE2EDuration="4.354729739s" totalImagesPullingTime="1.350893637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:24:56.354196255 +0000 UTC m=+362.139422131" watchObservedRunningTime="2026-07-02 21:24:56.354729739 +0000 UTC m=+362.139955594" Jul 02 21:25:17.342112 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:25:17.342076 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-gkkjr" Jul 02 21:26:00.094726 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.094684 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:00.097883 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.097860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.100526 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.100501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 02 21:26:00.100944 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.100923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 21:26:00.101067 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.101034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 21:26:00.101766 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.101740 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-n4vgk\"" Jul 02 21:26:00.110594 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.110539 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:00.167896 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.167857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.168083 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.167928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qpf\" (UniqueName: \"kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.268723 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.268679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qpf\" (UniqueName: \"kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.268918 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.268779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.268997 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:26:00.268925 2580 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 21:26:00.268997 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:26:00.268992 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert podName:629ba883-429a-44f6-a496-5a675496cde7 nodeName:}" failed. No retries permitted until 2026-07-02 21:26:00.768974333 +0000 UTC m=+426.554200169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert") pod "kserve-controller-manager-56668bddcf-hhhw5" (UID: "629ba883-429a-44f6-a496-5a675496cde7") : secret "kserve-webhook-server-cert" not found Jul 02 21:26:00.278687 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.278664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qpf\" (UniqueName: \"kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.772225 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.772186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:00.774790 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:00.774767 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") pod \"kserve-controller-manager-56668bddcf-hhhw5\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:01.008358 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:01.008300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:01.154494 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:01.154459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:01.159910 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:26:01.159872 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629ba883_429a_44f6_a496_5a675496cde7.slice/crio-05f114fff40d6e89832d37dd3906fa557934fdb6800bb5771bf60ccce2be410e WatchSource:0}: Error finding container 05f114fff40d6e89832d37dd3906fa557934fdb6800bb5771bf60ccce2be410e: Status 404 returned error can't find the container with id 05f114fff40d6e89832d37dd3906fa557934fdb6800bb5771bf60ccce2be410e Jul 02 21:26:01.570222 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:01.570186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" event={"ID":"629ba883-429a-44f6-a496-5a675496cde7","Type":"ContainerStarted","Data":"05f114fff40d6e89832d37dd3906fa557934fdb6800bb5771bf60ccce2be410e"} Jul 02 21:26:04.584131 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:04.584094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" event={"ID":"629ba883-429a-44f6-a496-5a675496cde7","Type":"ContainerStarted","Data":"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b"} Jul 02 21:26:04.584514 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:04.584206 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:04.604413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:04.604353 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" podStartSLOduration=2.213618141 podStartE2EDuration="4.604337788s" totalImagesPullingTime="2.390719647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:26:04.603294736 +0000 UTC m=+430.388520605" watchObservedRunningTime="2026-07-02 21:26:04.604337788 +0000 UTC m=+430.389563663" Jul 02 21:26:35.594581 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:35.594479 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:35.999008 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:35.998972 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:35.999193 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:35.999144 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" podUID="629ba883-429a-44f6-a496-5a675496cde7" containerName="manager" containerID="cri-o://f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b" gracePeriod=10 Jul 02 21:26:36.019084 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.019054 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-xwz6f"] Jul 02 21:26:36.022129 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.022110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.031448 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.031413 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-xwz6f"] Jul 02 21:26:36.136349 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.136296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db6771-9d36-429c-afc4-97f461e1bedc-cert\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.136518 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.136406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhlf6\" (UniqueName: \"kubernetes.io/projected/83db6771-9d36-429c-afc4-97f461e1bedc-kube-api-access-rhlf6\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.237085 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.237053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db6771-9d36-429c-afc4-97f461e1bedc-cert\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.237256 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.237107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhlf6\" (UniqueName: \"kubernetes.io/projected/83db6771-9d36-429c-afc4-97f461e1bedc-kube-api-access-rhlf6\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.239738 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.239710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db6771-9d36-429c-afc4-97f461e1bedc-cert\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.246057 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.246029 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:36.246202 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.246061 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhlf6\" (UniqueName: \"kubernetes.io/projected/83db6771-9d36-429c-afc4-97f461e1bedc-kube-api-access-rhlf6\") pod \"kserve-controller-manager-56668bddcf-xwz6f\" (UID: \"83db6771-9d36-429c-afc4-97f461e1bedc\") " pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.338168 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.338074 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") pod \"629ba883-429a-44f6-a496-5a675496cde7\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " Jul 02 21:26:36.338168 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.338133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49qpf\" (UniqueName: \"kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf\") pod \"629ba883-429a-44f6-a496-5a675496cde7\" (UID: \"629ba883-429a-44f6-a496-5a675496cde7\") " Jul 02 21:26:36.340497 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.340459 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf" (OuterVolumeSpecName: "kube-api-access-49qpf") pod "629ba883-429a-44f6-a496-5a675496cde7" (UID: "629ba883-429a-44f6-a496-5a675496cde7"). InnerVolumeSpecName "kube-api-access-49qpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:26:36.340497 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.340477 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert" (OuterVolumeSpecName: "cert") pod "629ba883-429a-44f6-a496-5a675496cde7" (UID: "629ba883-429a-44f6-a496-5a675496cde7"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:26:36.378248 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.378212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:36.439798 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.439728 2580 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/629ba883-429a-44f6-a496-5a675496cde7-cert\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:26:36.439798 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.439766 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49qpf\" (UniqueName: \"kubernetes.io/projected/629ba883-429a-44f6-a496-5a675496cde7-kube-api-access-49qpf\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:26:36.511951 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.511918 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-xwz6f"] Jul 02 21:26:36.515136 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:26:36.515108 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83db6771_9d36_429c_afc4_97f461e1bedc.slice/crio-cdc3864488a18a1c0efb636926fde61406eead6f0778a16d25f2fd1af0da0158 WatchSource:0}: Error finding container cdc3864488a18a1c0efb636926fde61406eead6f0778a16d25f2fd1af0da0158: Status 404 returned error can't find the container with id cdc3864488a18a1c0efb636926fde61406eead6f0778a16d25f2fd1af0da0158 Jul 02 21:26:36.701415 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.701377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" event={"ID":"83db6771-9d36-429c-afc4-97f461e1bedc","Type":"ContainerStarted","Data":"cdc3864488a18a1c0efb636926fde61406eead6f0778a16d25f2fd1af0da0158"} Jul 02 21:26:36.702700 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.702673 2580 generic.go:356] "Generic (PLEG): container finished" podID="629ba883-429a-44f6-a496-5a675496cde7" containerID="f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b" exitCode=0 Jul 02 21:26:36.702828 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.702709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" event={"ID":"629ba883-429a-44f6-a496-5a675496cde7","Type":"ContainerDied","Data":"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b"} Jul 02 21:26:36.702828 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.702721 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" Jul 02 21:26:36.702828 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.702744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-hhhw5" event={"ID":"629ba883-429a-44f6-a496-5a675496cde7","Type":"ContainerDied","Data":"05f114fff40d6e89832d37dd3906fa557934fdb6800bb5771bf60ccce2be410e"} Jul 02 21:26:36.702828 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.702766 2580 scope.go:117] "RemoveContainer" containerID="f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b" Jul 02 21:26:36.711521 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.711501 2580 scope.go:117] "RemoveContainer" containerID="f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b" Jul 02 21:26:36.711857 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:26:36.711836 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b\": container with ID starting with f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b not found: ID does not exist" containerID="f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b" Jul 02 21:26:36.711952 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.711866 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b"} err="failed to get container status \"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b\": rpc error: code = NotFound desc = could not find container \"f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b\": container with ID starting with f01c5c49a6b5d643efcc923f7ef19b7199e0c9892b8ef63a0356211320215f7b not found: ID does not exist" Jul 02 21:26:36.722862 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.722829 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:36.726692 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.726668 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-56668bddcf-hhhw5"] Jul 02 21:26:36.761536 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:36.761504 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629ba883-429a-44f6-a496-5a675496cde7" path="/var/lib/kubelet/pods/629ba883-429a-44f6-a496-5a675496cde7/volumes" Jul 02 21:26:37.709023 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:37.708983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" event={"ID":"83db6771-9d36-429c-afc4-97f461e1bedc","Type":"ContainerStarted","Data":"80866b5da2335068ba0a754d81e07d925bae91ddcfbe5b0d949ae75aaea4a5db"} Jul 02 21:26:37.709399 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:37.709121 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:26:37.724508 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:26:37.724456 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" podStartSLOduration=1.319766673 podStartE2EDuration="1.724434885s" totalImagesPullingTime="404.668212ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:26:37.723458574 +0000 UTC m=+463.508684449" watchObservedRunningTime="2026-07-02 21:26:37.724434885 +0000 UTC m=+463.509660742" Jul 02 21:27:08.717637 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:08.717607 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-56668bddcf-xwz6f" Jul 02 21:27:09.776401 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.776364 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-rcmsf"] Jul 02 21:27:09.776790 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.776640 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629ba883-429a-44f6-a496-5a675496cde7" containerName="manager" Jul 02 21:27:09.776790 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.776653 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="629ba883-429a-44f6-a496-5a675496cde7" containerName="manager" Jul 02 21:27:09.776790 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.776706 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="629ba883-429a-44f6-a496-5a675496cde7" containerName="manager" Jul 02 21:27:09.780805 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.780783 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:09.783776 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.783745 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-5qnmn\"" Jul 02 21:27:09.783987 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.783965 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 02 21:27:09.794333 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.794307 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jv4cb"] Jul 02 21:27:09.797282 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.797261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:09.797417 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.797340 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-rcmsf"] Jul 02 21:27:09.800858 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.800833 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-cz7r9\"" Jul 02 21:27:09.801055 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.801037 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 02 21:27:09.813706 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.813676 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jv4cb"] Jul 02 21:27:09.890177 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.890142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gkt\" (UniqueName: \"kubernetes.io/projected/37f80220-d32d-487a-bb87-e622617c0bdc-kube-api-access-69gkt\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:09.890177 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.890178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37f80220-d32d-487a-bb87-e622617c0bdc-tls-certs\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:09.890382 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.890210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghm8\" (UniqueName: \"kubernetes.io/projected/1c36dcce-2487-4c72-b627-7773ad105598-kube-api-access-tghm8\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:09.890382 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.890295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:09.991153 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.991105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tghm8\" (UniqueName: \"kubernetes.io/projected/1c36dcce-2487-4c72-b627-7773ad105598-kube-api-access-tghm8\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:09.991360 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.991179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:09.991360 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.991222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gkt\" (UniqueName: \"kubernetes.io/projected/37f80220-d32d-487a-bb87-e622617c0bdc-kube-api-access-69gkt\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:09.991360 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.991250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37f80220-d32d-487a-bb87-e622617c0bdc-tls-certs\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:09.991360 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:27:09.991313 2580 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 21:27:09.991597 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:27:09.991377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert podName:1c36dcce-2487-4c72-b627-7773ad105598 nodeName:}" failed. No retries permitted until 2026-07-02 21:27:10.49136091 +0000 UTC m=+496.276586745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert") pod "odh-model-controller-84b54b7f97-jv4cb" (UID: "1c36dcce-2487-4c72-b627-7773ad105598") : secret "odh-model-controller-webhook-cert" not found Jul 02 21:27:09.993908 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:09.993884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37f80220-d32d-487a-bb87-e622617c0bdc-tls-certs\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:10.000316 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.000290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghm8\" (UniqueName: \"kubernetes.io/projected/1c36dcce-2487-4c72-b627-7773ad105598-kube-api-access-tghm8\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:10.003229 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.003205 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gkt\" (UniqueName: \"kubernetes.io/projected/37f80220-d32d-487a-bb87-e622617c0bdc-kube-api-access-69gkt\") pod \"model-serving-api-fd65d7d6-rcmsf\" (UID: \"37f80220-d32d-487a-bb87-e622617c0bdc\") " pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:10.091933 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.091834 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:10.225841 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.225735 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-rcmsf"] Jul 02 21:27:10.228427 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:27:10.228402 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f80220_d32d_487a_bb87_e622617c0bdc.slice/crio-0497f1f501ed1f46b4ca326408a15c85dc069d74bda578780c254a560e4c50d0 WatchSource:0}: Error finding container 0497f1f501ed1f46b4ca326408a15c85dc069d74bda578780c254a560e4c50d0: Status 404 returned error can't find the container with id 0497f1f501ed1f46b4ca326408a15c85dc069d74bda578780c254a560e4c50d0 Jul 02 21:27:10.496669 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.496628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:10.499168 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.499148 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c36dcce-2487-4c72-b627-7773ad105598-cert\") pod \"odh-model-controller-84b54b7f97-jv4cb\" (UID: \"1c36dcce-2487-4c72-b627-7773ad105598\") " pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:10.707698 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.707586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:10.830016 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.829976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-rcmsf" event={"ID":"37f80220-d32d-487a-bb87-e622617c0bdc","Type":"ContainerStarted","Data":"0497f1f501ed1f46b4ca326408a15c85dc069d74bda578780c254a560e4c50d0"} Jul 02 21:27:10.875931 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:10.875769 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jv4cb"] Jul 02 21:27:10.883327 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:27:10.883294 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c36dcce_2487_4c72_b627_7773ad105598.slice/crio-9200fc3e529ec44e06660f5c2ca3ef790660a1d3fa1b0f2bb4acc23bebadee2b WatchSource:0}: Error finding container 9200fc3e529ec44e06660f5c2ca3ef790660a1d3fa1b0f2bb4acc23bebadee2b: Status 404 returned error can't find the container with id 9200fc3e529ec44e06660f5c2ca3ef790660a1d3fa1b0f2bb4acc23bebadee2b Jul 02 21:27:11.837219 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:11.837177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-rcmsf" event={"ID":"37f80220-d32d-487a-bb87-e622617c0bdc","Type":"ContainerStarted","Data":"a0850951cbc37616f17f00c3b372c6e0c1ca8e18a801d98f3dcd80dbadfc6f69"} Jul 02 21:27:11.837705 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:11.837367 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:11.839059 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:11.839023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" event={"ID":"1c36dcce-2487-4c72-b627-7773ad105598","Type":"ContainerStarted","Data":"9200fc3e529ec44e06660f5c2ca3ef790660a1d3fa1b0f2bb4acc23bebadee2b"} Jul 02 21:27:11.855776 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:11.855714 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-rcmsf" podStartSLOduration=1.330867424 podStartE2EDuration="2.855696464s" totalImagesPullingTime="1.52482904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:27:11.854158147 +0000 UTC m=+497.639384028" watchObservedRunningTime="2026-07-02 21:27:11.855696464 +0000 UTC m=+497.640922321" Jul 02 21:27:13.848778 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:13.848743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" event={"ID":"1c36dcce-2487-4c72-b627-7773ad105598","Type":"ContainerStarted","Data":"aa868103a14acec84d5435430cad456a3b172b82de5878c9d5f28d0e127dc8db"} Jul 02 21:27:13.849182 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:13.848875 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:27:13.866881 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:13.866830 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" podStartSLOduration=2.146517025 podStartE2EDuration="4.866812223s" totalImagesPullingTime="2.720295198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:27:13.865968083 +0000 UTC m=+499.651193960" watchObservedRunningTime="2026-07-02 21:27:13.866812223 +0000 UTC m=+499.652038079" Jul 02 21:27:22.848246 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:22.848208 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-rcmsf" Jul 02 21:27:24.855539 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:27:24.855507 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-jv4cb" Jul 02 21:28:54.624479 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:28:54.624440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:28:54.628616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:28:54.628592 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:32:31.882612 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.882580 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:32:31.885868 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.885844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:31.888215 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.888190 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c1b1e-kube-rbac-proxy-sar-config\"" Jul 02 21:32:31.888364 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.888228 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c1b1e-serving-cert\"" Jul 02 21:32:31.888364 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.888239 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:32:31.888364 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.888228 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-57xll\"" Jul 02 21:32:31.894673 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:31.894646 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:32:32.001765 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.001735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.001963 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.001782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.102690 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.102642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.102864 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.102707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.102864 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:32:32.102830 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c1b1e-serving-cert: secret "model-chainer-raw-c1b1e-serving-cert" not found Jul 02 21:32:32.102940 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:32:32.102884 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls podName:f660bd15-3bad-424e-bc3f-69fa51f6090b nodeName:}" failed. No retries permitted until 2026-07-02 21:32:32.602868419 +0000 UTC m=+818.388094252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls") pod "model-chainer-raw-c1b1e-5f996d4464-flxrp" (UID: "f660bd15-3bad-424e-bc3f-69fa51f6090b") : secret "model-chainer-raw-c1b1e-serving-cert" not found Jul 02 21:32:32.103331 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.103310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.607189 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.607147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.609750 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.609726 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") pod \"model-chainer-raw-c1b1e-5f996d4464-flxrp\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.797844 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.797807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:32.937257 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.937222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:32:32.940711 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:32:32.940680 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf660bd15_3bad_424e_bc3f_69fa51f6090b.slice/crio-f497e962dddd4dbd099e7038568b994e102295a779d0017ac23810455ed63634 WatchSource:0}: Error finding container f497e962dddd4dbd099e7038568b994e102295a779d0017ac23810455ed63634: Status 404 returned error can't find the container with id f497e962dddd4dbd099e7038568b994e102295a779d0017ac23810455ed63634 Jul 02 21:32:32.942945 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:32.942923 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:32:33.008699 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:33.008665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" event={"ID":"f660bd15-3bad-424e-bc3f-69fa51f6090b","Type":"ContainerStarted","Data":"f497e962dddd4dbd099e7038568b994e102295a779d0017ac23810455ed63634"} Jul 02 21:32:36.025354 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:36.025316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" event={"ID":"f660bd15-3bad-424e-bc3f-69fa51f6090b","Type":"ContainerStarted","Data":"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b"} Jul 02 21:32:36.025766 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:36.025475 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:32:36.041788 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:36.041736 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podStartSLOduration=2.7400320970000003 podStartE2EDuration="5.04171818s" totalImagesPullingTime="2.301686083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:36.040772605 +0000 UTC m=+821.825998483" watchObservedRunningTime="2026-07-02 21:32:36.04171818 +0000 UTC m=+821.826944043" Jul 02 21:32:41.953124 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:41.953088 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:32:41.953530 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:41.953296 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" containerID="cri-o://702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b" gracePeriod=30 Jul 02 21:32:41.959233 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:41.959179 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:32:46.959590 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:46.959537 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:32:51.957487 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:51.957444 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:32:56.957415 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:32:56.957369 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:33:01.957789 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:01.957749 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:33:06.958081 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:06.958040 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:33:11.958105 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:11.957855 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" probeResult="failure" output="Get \"https://10.134.0.20:8080/readyz\": dial tcp 10.134.0.20:8080: connect: connection refused" Jul 02 21:33:12.108167 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.108135 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:33:12.156010 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.155980 2580 generic.go:356] "Generic (PLEG): container finished" podID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerID="702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b" exitCode=0 Jul 02 21:33:12.156184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.156030 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" Jul 02 21:33:12.156184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.156046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" event={"ID":"f660bd15-3bad-424e-bc3f-69fa51f6090b","Type":"ContainerDied","Data":"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b"} Jul 02 21:33:12.156184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.156089 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp" event={"ID":"f660bd15-3bad-424e-bc3f-69fa51f6090b","Type":"ContainerDied","Data":"f497e962dddd4dbd099e7038568b994e102295a779d0017ac23810455ed63634"} Jul 02 21:33:12.156184 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.156111 2580 scope.go:117] "RemoveContainer" containerID="702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b" Jul 02 21:33:12.164266 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.164247 2580 scope.go:117] "RemoveContainer" containerID="702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b" Jul 02 21:33:12.164537 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:33:12.164516 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b\": container with ID starting with 702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b not found: ID does not exist" containerID="702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b" Jul 02 21:33:12.164631 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.164546 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b"} err="failed to get container status \"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b\": rpc error: code = NotFound desc = could not find container \"702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b\": container with ID starting with 702eda58b6d232dd6a34d2cf4ac0da89fb511ff16593ba044e228272f4e7ed0b not found: ID does not exist" Jul 02 21:33:12.228269 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.228187 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle\") pod \"f660bd15-3bad-424e-bc3f-69fa51f6090b\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " Jul 02 21:33:12.228269 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.228271 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") pod \"f660bd15-3bad-424e-bc3f-69fa51f6090b\" (UID: \"f660bd15-3bad-424e-bc3f-69fa51f6090b\") " Jul 02 21:33:12.228547 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.228521 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f660bd15-3bad-424e-bc3f-69fa51f6090b" (UID: "f660bd15-3bad-424e-bc3f-69fa51f6090b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:33:12.230675 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.230652 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f660bd15-3bad-424e-bc3f-69fa51f6090b" (UID: "f660bd15-3bad-424e-bc3f-69fa51f6090b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:33:12.329291 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.329247 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f660bd15-3bad-424e-bc3f-69fa51f6090b-proxy-tls\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:33:12.329291 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.329283 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f660bd15-3bad-424e-bc3f-69fa51f6090b-openshift-service-ca-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:33:12.484439 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.484360 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:33:12.490880 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.490848 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c1b1e-5f996d4464-flxrp"] Jul 02 21:33:12.761806 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:12.761727 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" path="/var/lib/kubelet/pods/f660bd15-3bad-424e-bc3f-69fa51f6090b/volumes" Jul 02 21:33:54.648345 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:54.648317 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:33:54.649359 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:33:54.649341 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:34:22.204325 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.204286 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:34:22.204745 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.204607 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" Jul 02 21:34:22.204745 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.204619 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" Jul 02 21:34:22.204745 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.204663 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f660bd15-3bad-424e-bc3f-69fa51f6090b" containerName="model-chainer-raw-c1b1e" Jul 02 21:34:22.207492 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.207471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.209968 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.209947 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-af6d2-serving-cert\"" Jul 02 21:34:22.210082 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.209960 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-57xll\"" Jul 02 21:34:22.210891 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.210865 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 21:34:22.210891 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.210887 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-af6d2-kube-rbac-proxy-sar-config\"" Jul 02 21:34:22.220097 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.220073 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:34:22.318079 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.318045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.318266 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.318152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.418794 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.418762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.418961 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.418808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.419474 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.419452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.421276 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.421258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls\") pod \"model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.518336 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.518243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:22.649523 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:22.649491 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:34:22.653156 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:34:22.653120 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda437d0de_4e8a_481f_a008_e8f0b374ecd1.slice/crio-4e89d9d3049ded0ae65053059298f0d6881a724a48be51a27ddc738a8cc56f84 WatchSource:0}: Error finding container 4e89d9d3049ded0ae65053059298f0d6881a724a48be51a27ddc738a8cc56f84: Status 404 returned error can't find the container with id 4e89d9d3049ded0ae65053059298f0d6881a724a48be51a27ddc738a8cc56f84 Jul 02 21:34:23.418176 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:23.418137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" event={"ID":"a437d0de-4e8a-481f-a008-e8f0b374ecd1","Type":"ContainerStarted","Data":"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c"} Jul 02 21:34:23.418631 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:23.418191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" event={"ID":"a437d0de-4e8a-481f-a008-e8f0b374ecd1","Type":"ContainerStarted","Data":"4e89d9d3049ded0ae65053059298f0d6881a724a48be51a27ddc738a8cc56f84"} Jul 02 21:34:23.418631 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:23.418303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:23.433411 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:23.433335 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podStartSLOduration=1.433319211 podStartE2EDuration="1.433319211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:34:23.432595228 +0000 UTC m=+929.217821100" watchObservedRunningTime="2026-07-02 21:34:23.433319211 +0000 UTC m=+929.218545067" Jul 02 21:34:29.427889 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:29.427860 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:32.263925 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:32.263892 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:34:32.264368 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:32.264073 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" containerID="cri-o://fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c" gracePeriod=30 Jul 02 21:34:34.425648 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:34.425604 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:34:39.426100 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:39.426057 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:34:44.426935 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:44.426885 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:34:44.427406 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:44.427015 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:34:49.425648 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:49.425590 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:34:54.425638 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:54.425600 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:34:59.426346 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:34:59.426305 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 21:35:02.414895 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.414865 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:35:02.526114 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.526005 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle\") pod \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " Jul 02 21:35:02.526114 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.526082 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls\") pod \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\" (UID: \"a437d0de-4e8a-481f-a008-e8f0b374ecd1\") " Jul 02 21:35:02.526379 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.526354 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a437d0de-4e8a-481f-a008-e8f0b374ecd1" (UID: "a437d0de-4e8a-481f-a008-e8f0b374ecd1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:35:02.528385 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.528349 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a437d0de-4e8a-481f-a008-e8f0b374ecd1" (UID: "a437d0de-4e8a-481f-a008-e8f0b374ecd1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:35:02.569676 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.569641 2580 generic.go:356] "Generic (PLEG): container finished" podID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerID="fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c" exitCode=0 Jul 02 21:35:02.569874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.569688 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" Jul 02 21:35:02.569874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.569734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" event={"ID":"a437d0de-4e8a-481f-a008-e8f0b374ecd1","Type":"ContainerDied","Data":"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c"} Jul 02 21:35:02.569874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.569793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4" event={"ID":"a437d0de-4e8a-481f-a008-e8f0b374ecd1","Type":"ContainerDied","Data":"4e89d9d3049ded0ae65053059298f0d6881a724a48be51a27ddc738a8cc56f84"} Jul 02 21:35:02.569874 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.569828 2580 scope.go:117] "RemoveContainer" containerID="fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c" Jul 02 21:35:02.578175 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.578157 2580 scope.go:117] "RemoveContainer" containerID="fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c" Jul 02 21:35:02.578542 ip-10-0-133-168 kubenswrapper[2580]: E0702 21:35:02.578522 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c\": container with ID starting with fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c not found: ID does not exist" containerID="fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c" Jul 02 21:35:02.578619 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.578579 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c"} err="failed to get container status \"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c\": rpc error: code = NotFound desc = could not find container \"fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c\": container with ID starting with fcfac36e9ad9a7767a5c476a205a40a9693e3cccfde1f5ce1774925b9696456c not found: ID does not exist" Jul 02 21:35:02.591327 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.591290 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:35:02.595367 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.595342 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-af6d2-6cc8cfdbb5-prxz4"] Jul 02 21:35:02.627526 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.627489 2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a437d0de-4e8a-481f-a008-e8f0b374ecd1-openshift-service-ca-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:35:02.627526 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.627525 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a437d0de-4e8a-481f-a008-e8f0b374ecd1-proxy-tls\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\"" Jul 02 21:35:02.760952 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:35:02.760913 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" path="/var/lib/kubelet/pods/a437d0de-4e8a-481f-a008-e8f0b374ecd1/volumes" Jul 02 21:38:54.672973 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:38:54.672939 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:38:54.673970 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:38:54.673947 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:43:54.694900 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:43:54.694872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:43:54.697163 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:43:54.697140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:44:39.399472 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:39.399441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x2wx7_8bd1f137-236c-40e6-a679-77e03159e3c9/global-pull-secret-syncer/0.log" Jul 02 21:44:39.488387 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:39.488357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbxwk_bd9c3932-d38d-4020-a8ef-082711c631f7/konnectivity-agent/0.log" Jul 02 21:44:39.541249 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:39.541218 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-168.ec2.internal_7adefaaa136cd969be6ccf9e8d124d5f/haproxy/0.log" Jul 02 21:44:43.804413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:43.804382 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8r2tk_9013a7c8-b939-49e5-8c80-e89d30b8b97d/node-exporter/0.log" Jul 02 21:44:43.829100 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:43.829072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8r2tk_9013a7c8-b939-49e5-8c80-e89d30b8b97d/kube-rbac-proxy/0.log" Jul 02 21:44:43.861793 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:43.861772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8r2tk_9013a7c8-b939-49e5-8c80-e89d30b8b97d/init-textfile/0.log" Jul 02 21:44:47.527967 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.527934 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72"] Jul 02 21:44:47.528413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.528208 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" Jul 02 21:44:47.528413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.528219 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" Jul 02 21:44:47.528413 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.528270 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a437d0de-4e8a-481f-a008-e8f0b374ecd1" containerName="model-chainer-raw-hpa-af6d2" Jul 02 21:44:47.531151 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.531134 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.533651 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.533612 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-thbg4\"/\"openshift-service-ca.crt\"" Jul 02 21:44:47.533810 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.533790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-thbg4\"/\"default-dockercfg-ls6ns\"" Jul 02 21:44:47.533892 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.533812 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-thbg4\"/\"kube-root-ca.crt\"" Jul 02 21:44:47.542003 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.541972 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72"] Jul 02 21:44:47.615628 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.615584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-proc\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.615834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.615645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-podres\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.615834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.615729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-lib-modules\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.615834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.615771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-sys\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.615834 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.615807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qdd\" (UniqueName: \"kubernetes.io/projected/424ac2e6-fc88-458a-9007-635390c04f74-kube-api-access-67qdd\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717091 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-sys\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qdd\" (UniqueName: \"kubernetes.io/projected/424ac2e6-fc88-458a-9007-635390c04f74-kube-api-access-67qdd\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-proc\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717181 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-sys\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-podres\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717242 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-proc\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717286 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-lib-modules\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-lib-modules\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.717600 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.717365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/424ac2e6-fc88-458a-9007-635390c04f74-podres\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.725542 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.725521 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qdd\" (UniqueName: \"kubernetes.io/projected/424ac2e6-fc88-458a-9007-635390c04f74-kube-api-access-67qdd\") pod \"perf-node-gather-daemonset-h8q72\" (UID: \"424ac2e6-fc88-458a-9007-635390c04f74\") " pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.841724 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.841622 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:47.973963 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:47.973926 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72"] Jul 02 21:44:47.977155 ip-10-0-133-168 kubenswrapper[2580]: W0702 21:44:47.977114 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod424ac2e6_fc88_458a_9007_635390c04f74.slice/crio-1ecfab9c2da31e3083e80a1a3248afc77727e1ce780a9b96c3717698d1691315 WatchSource:0}: Error finding container 1ecfab9c2da31e3083e80a1a3248afc77727e1ce780a9b96c3717698d1691315: Status 404 returned error can't find the container with id 1ecfab9c2da31e3083e80a1a3248afc77727e1ce780a9b96c3717698d1691315 Jul 02 21:44:48.384959 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.384932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz5ml_7414621c-2028-4391-b804-51558b21d753/dns/0.log" Jul 02 21:44:48.405254 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.405225 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz5ml_7414621c-2028-4391-b804-51558b21d753/kube-rbac-proxy/0.log" Jul 02 21:44:48.475616 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.475579 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48nnv_4d8ebd78-ac9a-4676-8a2a-49ddb6b90dde/dns-node-resolver/0.log" Jul 02 21:44:48.678634 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.678535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" event={"ID":"424ac2e6-fc88-458a-9007-635390c04f74","Type":"ContainerStarted","Data":"8e27cd32d31ad851fba984d6425f249fce2707e8d1a555941713cf5817ab17d9"} Jul 02 21:44:48.678634 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.678599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" event={"ID":"424ac2e6-fc88-458a-9007-635390c04f74","Type":"ContainerStarted","Data":"1ecfab9c2da31e3083e80a1a3248afc77727e1ce780a9b96c3717698d1691315"} Jul 02 21:44:48.679053 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.678639 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:48.694512 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:48.694444 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" podStartSLOduration=1.694427299 podStartE2EDuration="1.694427299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:48.692525787 +0000 UTC m=+1554.477751673" watchObservedRunningTime="2026-07-02 21:44:48.694427299 +0000 UTC m=+1554.479653193" Jul 02 21:44:49.040500 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:49.040396 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvvtt_f77ee42a-d401-43a7-ab64-aa6fda52b1f7/node-ca/0.log" Jul 02 21:44:49.845672 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:49.845635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cc8f7f95-rp5gk_669b326b-1e71-4f5b-ac30-d2174600185d/router/0.log" Jul 02 21:44:50.255572 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.255526 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvgx8_d25ef769-f55b-4956-b3c1-cd0956c81a20/serve-healthcheck-canary/0.log" Jul 02 21:44:50.631434 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.631386 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bwl8z_cc178907-cf96-496a-8858-a535e8c08dab/insights-operator/0.log" Jul 02 21:44:50.631434 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.631408 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bwl8z_cc178907-cf96-496a-8858-a535e8c08dab/insights-operator/1.log" Jul 02 21:44:50.719977 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.719945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6bc9_cec824c1-7384-4c3b-a0b4-933c4b8872b1/kube-rbac-proxy/0.log" Jul 02 21:44:50.743649 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.743621 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6bc9_cec824c1-7384-4c3b-a0b4-933c4b8872b1/exporter/0.log" Jul 02 21:44:50.767216 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:50.767186 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6bc9_cec824c1-7384-4c3b-a0b4-933c4b8872b1/extractor/0.log" Jul 02 21:44:52.861424 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:52.861397 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-56668bddcf-xwz6f_83db6771-9d36-429c-afc4-97f461e1bedc/manager/0.log" Jul 02 21:44:52.904860 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:52.904832 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-rcmsf_37f80220-d32d-487a-bb87-e622617c0bdc/server/0.log" Jul 02 21:44:53.036902 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:53.036863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-jv4cb_1c36dcce-2487-4c72-b627-7773ad105598/manager/0.log" Jul 02 21:44:54.692984 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:54.692956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-thbg4/perf-node-gather-daemonset-h8q72" Jul 02 21:44:57.098796 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:57.098770 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bs4xt_831356ce-70d0-4ba1-9293-79be4b13d2f2/migrator/0.log" Jul 02 21:44:57.126963 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:57.126934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bs4xt_831356ce-70d0-4ba1-9293-79be4b13d2f2/graceful-termination/0.log" Jul 02 21:44:58.679760 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.679724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/kube-multus-additional-cni-plugins/0.log" Jul 02 21:44:58.703100 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.703073 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/egress-router-binary-copy/0.log" Jul 02 21:44:58.728164 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.728135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/cni-plugins/0.log" Jul 02 21:44:58.751297 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.751267 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/bond-cni-plugin/0.log" Jul 02 21:44:58.772310 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.772272 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/routeoverride-cni/0.log" Jul 02 21:44:58.793730 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.793637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/whereabouts-cni-bincopy/0.log" Jul 02 21:44:58.815292 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.815259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vftx7_348541db-0e6f-4049-9504-e86f371cfe87/whereabouts-cni/0.log" Jul 02 21:44:58.877710 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.877679 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fdk2r_bbcd54d7-d5d5-48ff-8728-755550dde21d/kube-multus/0.log" Jul 02 21:44:58.980423 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:58.980398 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l8mj5_e4378b38-ddf0-4880-9256-44d68159e682/network-metrics-daemon/0.log" Jul 02 21:44:59.001499 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.001466 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l8mj5_e4378b38-ddf0-4880-9256-44d68159e682/kube-rbac-proxy/0.log" Jul 02 21:44:59.939029 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.938978 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-controller/0.log" Jul 02 21:44:59.955196 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.955165 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/1.log" Jul 02 21:44:59.955404 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.955320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovn-acl-logging/0.log" Jul 02 21:44:59.973281 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.973241 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/kube-rbac-proxy-node/0.log" Jul 02 21:44:59.996456 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:44:59.996420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 21:45:00.015857 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:00.015816 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/northd/0.log" Jul 02 21:45:00.039139 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:00.039107 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/nbdb/0.log" Jul 02 21:45:00.060932 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:00.060903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/sbdb/0.log" Jul 02 21:45:00.120978 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:00.120947 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gz4j_7f75f1f5-f406-44f8-8737-31ab659331a9/ovnkube-controller/0.log" Jul 02 21:45:01.342725 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:01.342691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p5c6h_f2f32bda-dd1a-4906-b905-9f2a0765e1f8/network-check-target-container/0.log" Jul 02 21:45:02.220735 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:02.220704 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xmdms_83d53481-14d4-414e-a628-b1d3ad7bdf28/iptables-alerter/0.log" Jul 02 21:45:02.826128 ip-10-0-133-168 kubenswrapper[2580]: I0702 21:45:02.826103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7rwbj_1b088969-e2c4-4d23-9770-7f3d4b8dd96a/tuned/0.log"