Jul 28 17:22:52.804492 ip-10-0-141-94 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:22:53.258302 ip-10-0-141-94 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:53.258302 ip-10-0-141-94 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:22:53.258302 ip-10-0-141-94 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:53.258302 ip-10-0-141-94 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:22:53.258302 ip-10-0-141-94 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:22:53.259507 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.258313 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265325 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265349 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265353 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265356 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265359 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265362 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265365 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.265354 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265368 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265371 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265374 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265377 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265380 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265383 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265385 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265388 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265390 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265393 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265396 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265398 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265401 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265403 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265406 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265409 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265411 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265414 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265417 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265419 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.265659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265422 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265426 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265430 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265433 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265436 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265438 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265441 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265443 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265446 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265448 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265451 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265453 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265455 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265458 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265462 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265465 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265467 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265469 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265472 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265475 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.266145 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265478 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265480 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265483 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265486 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265489 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265491 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265494 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265497 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265500 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265502 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265505 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265507 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265509 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265513 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265515 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265517 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265520 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265523 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265525 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.266654 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265530 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265535 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265538 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265541 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265544 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265547 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265551 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265554 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265556 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265559 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265562 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265564 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265567 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265569 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265572 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265574 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265577 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265581 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265584 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265586 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.267148 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265589 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265592 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265594 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265606 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265608 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265611 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265613 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265616 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265619 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265621 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265624 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265628 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.267670 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.265631 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.268035 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268021 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.268035 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268035 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268039 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268042 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268045 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268048 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268050 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268053 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268057 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268060 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268063 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268066 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268069 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268073 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268076 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268079 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268082 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268086 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268089 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268092 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.268088 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268095 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268099 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268103 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268105 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268108 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268111 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268113 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268116 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268118 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268121 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268123 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268126 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268129 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268131 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268133 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268136 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268139 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268141 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268143 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.268620 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268146 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268148 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268151 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268153 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268172 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268175 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268177 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268180 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268184 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268186 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268188 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268191 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268194 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268196 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268199 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268202 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268205 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268207 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268210 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268213 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.269130 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268216 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268219 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268223 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268227 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268231 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268234 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268236 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268239 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268242 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268244 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268246 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268249 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268251 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268254 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268256 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268259 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268261 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268264 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268267 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268269 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.269663 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268272 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268274 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268277 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268279 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268284 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268286 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268289 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268293 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268296 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268299 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268301 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268304 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268307 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268309 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268312 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268314 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268316 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268319 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268321 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.270173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268324 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268752 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268757 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268761 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268763 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268766 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268768 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268771 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268774 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268776 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268779 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268781 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268784 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268787 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268789 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268792 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268794 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268797 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268800 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268803 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.270639 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268806 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268809 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268811 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268814 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268816 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268819 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268821 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268824 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268826 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268829 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268832 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268836 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268839 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268841 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268844 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268846 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268849 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268851 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268854 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268857 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.271270 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268859 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268861 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268864 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268866 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268869 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268871 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268874 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268876 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268879 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268881 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268884 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268886 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268892 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268895 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268898 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268900 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268903 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268905 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268908 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268911 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.271771 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268913 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268916 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268919 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268921 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268924 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268927 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268930 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268934 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268937 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268939 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268942 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268944 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268949 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268952 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268955 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268957 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268960 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268962 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268965 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268967 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.272282 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268970 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268972 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268975 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268977 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268982 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268986 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268989 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268992 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268994 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.268997 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269000 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269002 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269004 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269006 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269009 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269012 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269014 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269016 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269019 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.272762 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269021 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269104 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269112 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269126 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269131 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269135 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269139 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269143 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269148 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269151 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269168 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269173 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269176 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269179 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269182 2559 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269185 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269188 2559 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269193 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269196 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269201 2559 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269203 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269206 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269210 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269213 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:22:53.273232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269216 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269219 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269222 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269226 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269229 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269232 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269235 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269238 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269242 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269246 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269249 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269252 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269255 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269258 2559 flags.go:64] FLAG: --enable-server="true" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269261 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269285 2559 flags.go:64] FLAG: --event-burst="100" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269288 2559 flags.go:64] FLAG: --event-qps="50" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269291 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269294 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269297 2559 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269301 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269304 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269307 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269310 2559 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269313 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:22:53.273825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269316 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269320 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269323 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269326 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269329 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269331 2559 flags.go:64] FLAG: --feature-gates="" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269335 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269339 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269342 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269345 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269347 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269351 2559 flags.go:64] FLAG: --help="false" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269353 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269356 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269359 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269362 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269365 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269368 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269371 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269374 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269377 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269380 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269382 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269385 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:22:53.274488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269388 2559 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269391 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269394 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269396 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269399 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269401 2559 flags.go:64] FLAG: --lock-file="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269405 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269408 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269411 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269417 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269421 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269424 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269426 2559 flags.go:64] FLAG: --logging-format="text" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269429 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269432 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269435 2559 flags.go:64] FLAG: --manifest-url="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269438 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269443 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269445 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269450 2559 flags.go:64] FLAG: --max-pods="110" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269452 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269455 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269458 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269461 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269464 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:22:53.275083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269466 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269469 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269477 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269480 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269483 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269486 2559 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269488 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269494 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269497 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269500 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269502 2559 flags.go:64] FLAG: --port="10250" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269505 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269508 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06a875a81ecb80086" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269512 2559 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269515 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269518 2559 flags.go:64] FLAG: --register-node="true" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269521 2559 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269524 2559 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269528 2559 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269531 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269534 2559 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269538 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269540 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269543 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269546 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:22:53.275730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269549 2559 flags.go:64] FLAG: --runonce="false" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269552 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269555 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269558 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269561 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269563 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269566 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269569 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269572 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269575 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269578 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269581 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269583 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269586 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269589 2559 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269592 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269609 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269612 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269615 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269620 2559 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269626 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269629 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269633 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269636 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269639 2559 flags.go:64] FLAG: --v="2" Jul 28 17:22:53.276363 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269643 2559 flags.go:64] FLAG: --version="false" Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269648 2559 flags.go:64] FLAG: --vmodule="" Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269652 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.269656 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269790 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269794 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269798 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269801 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269804 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269806 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269809 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269811 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269814 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269817 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269819 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269822 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269824 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269827 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269829 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269832 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.276966 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269834 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269837 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269840 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269842 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269845 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269847 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269849 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269855 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269857 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269863 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269866 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269868 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269871 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269873 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269877 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269880 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269884 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269888 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269891 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269894 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.277481 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269897 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269901 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269904 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269906 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269909 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269912 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269914 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269917 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269919 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269922 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269925 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269927 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269930 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269933 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269935 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269937 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269940 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269942 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269945 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269949 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.278011 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269951 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269955 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269958 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269960 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269963 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269965 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269968 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269971 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269974 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269976 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269979 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269981 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269984 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269987 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269989 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269992 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269995 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.269997 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270000 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.278567 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270002 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270005 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270007 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270010 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270012 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270015 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270017 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270020 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270022 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270025 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270027 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270031 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270036 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270038 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270042 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270046 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270050 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270053 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270056 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.279029 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270058 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270061 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270064 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270066 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.270069 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.271100 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.279175 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:22:53.279516 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.279195 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:22:53.280099 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.280087 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:22:53.280130 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.280099 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280179 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280186 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280189 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280192 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280195 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280198 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280201 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280204 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280206 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280210 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280212 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280215 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280220 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280223 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280225 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280228 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280230 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280234 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.280283 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280236 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280239 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280241 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280243 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280246 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280249 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280251 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280254 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280256 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280259 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280263 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280266 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280268 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280271 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280274 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280277 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280279 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280282 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280284 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280287 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.280778 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280289 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280292 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280294 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280297 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280300 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280302 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280305 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280307 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280310 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280313 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280316 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280318 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280321 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280323 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280326 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280328 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280331 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280333 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280336 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280339 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.281287 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280342 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280344 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280347 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280350 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280352 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280355 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280358 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280361 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280364 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280367 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280369 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280372 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280374 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280377 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280380 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280383 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280386 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280388 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280391 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.281803 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280394 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280396 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280399 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280402 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280405 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280410 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280412 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280415 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280417 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280421 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280425 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280428 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280431 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280434 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280437 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280439 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280442 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280446 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.282319 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280450 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280454 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280456 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.280462 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280581 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280587 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280590 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280593 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280595 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280598 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280602 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280607 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280610 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280612 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:22:53.282760 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280615 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280618 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280621 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280623 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280626 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280628 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280631 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280634 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280637 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280639 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280642 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280645 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280647 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280650 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280652 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280655 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280658 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280663 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280666 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:22:53.283125 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280669 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280672 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280674 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280677 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280679 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280682 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280684 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280686 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280689 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280691 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280694 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280696 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280699 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280702 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280704 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280707 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280709 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280712 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280714 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280717 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:22:53.283629 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280719 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280721 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280724 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280726 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280728 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280731 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280734 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280736 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280739 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280742 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280744 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280748 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280750 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280753 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280755 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280758 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280761 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280764 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280767 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:22:53.284139 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280770 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280773 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280775 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280778 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280781 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280783 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280786 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280789 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280792 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280794 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280797 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280799 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280802 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280804 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280807 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280809 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280811 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280814 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280816 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280818 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:22:53.284627 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280821 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280824 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280826 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280829 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280832 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280836 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280839 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280842 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280844 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:53.280847 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.280851 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.280989 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.283201 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.284874 2559 server.go:1019] "Starting client certificate rotation" Jul 28 17:22:53.285137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.284975 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:22:53.285515 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.285015 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:22:53.287534 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.287516 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:22:53.294621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.294591 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:22:53.310223 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.310189 2559 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:22:53.312754 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.312732 2559 log.go:25] "Validated CRI v1 image API" Jul 28 17:22:53.313209 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.313153 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:22:53.313708 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.313692 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:22:53.320300 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.320274 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c685429-eaad-4ed2-9b5b-49b825b2caba:/dev/nvme0n1p3 ae329d0d-d4df-428d-a955-048874cb71c8:/dev/nvme0n1p4] Jul 28 17:22:53.320406 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.320298 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:22:53.325790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.325649 2559 manager.go:216] Machine: {Timestamp:2026-07-28 17:22:53.324058098 +0000 UTC m=+0.393301967 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094322 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2edae97117fdd03158cb6ca4582f55 SystemUUID:ec2edae9-7117-fdd0-3158-cb6ca4582f55 BootID:26bb233e-d5ae-4438-bb4f-07cc96dba2eb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:0a:c3:da:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:0a:c3:da:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:8f:8c:84:2a:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:22:53.325790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.325779 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:22:53.325915 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.325881 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:22:53.330134 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.330087 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:22:53.330324 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.330136 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:22:53.331329 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.331314 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:22:53.331376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.331330 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:22:53.331376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.331338 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:22:53.332198 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.332182 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:22:53.333291 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.333280 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:22:53.335181 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.335143 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klndh" Jul 28 17:22:53.335458 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.335446 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:22:53.335595 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.335585 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:22:53.336258 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336245 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:22:53.336318 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336267 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:22:53.336318 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336289 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:22:53.336318 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336299 2559 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:22:53.336318 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336310 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:22:53.336761 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336747 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:22:53.336797 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.336773 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:22:53.339297 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.339275 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:22:53.341672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.341655 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:22:53.341749 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.341686 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:22:53.343958 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343943 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:22:53.343958 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343960 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343966 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343971 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343981 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343987 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.343996 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.344001 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.344007 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.344013 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.344021 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:22:53.344083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.344027 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:22:53.346325 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.346305 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klndh" Jul 28 17:22:53.346930 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.346916 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:22:53.346930 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.346930 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:22:53.347755 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.347701 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:22:53.347842 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.347804 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:22:53.350499 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.350485 2559 server.go:1268] "Started kubelet" Jul 28 17:22:53.355789 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.350597 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:22:53.355903 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.355761 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:22:53.355903 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.355863 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:22:53.356829 ip-10-0-141-94 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:22:53.358440 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.357971 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:22:53.359475 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.359458 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:22:53.362953 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.362925 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:22:53.368208 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.368190 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:22:53.368300 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.368218 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:22:53.368356 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.368317 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.368425 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.368380 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-94.ec2.internal" not found Jul 28 17:22:53.369258 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369242 2559 factory.go:55] Registering systemd factory Jul 28 17:22:53.369442 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369422 2559 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:22:53.369547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369305 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:22:53.369671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369655 2559 factory.go:153] Registering CRI-O factory Jul 28 17:22:53.369730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369674 2559 factory.go:223] Registration of the crio container factory successfully Jul 28 17:22:53.369764 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369734 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:22:53.369764 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369759 2559 factory.go:103] Registering Raw factory Jul 28 17:22:53.369870 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.369773 2559 manager.go:1196] Started watching for new ooms in manager Jul 28 17:22:53.370207 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370187 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:22:53.370296 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370211 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:22:53.370296 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370193 2559 manager.go:349] Starting recovery of all containers Jul 28 17:22:53.370395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370374 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:22:53.370395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370385 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:22:53.370671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.370638 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:53.373377 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.373349 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-94.ec2.internal\" not found" node="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.380250 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.380070 2559 manager.go:354] Recovery completed Jul 28 17:22:53.384323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.384308 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-94.ec2.internal" not found Jul 28 17:22:53.384566 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.384553 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.386509 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.386492 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.386595 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.386523 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.386595 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.386533 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.387077 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.387065 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:22:53.387138 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.387076 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:22:53.387138 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.387095 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:22:53.387239 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.387068 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.389042 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.389030 2559 policy_none.go:49] "None policy: Start" Jul 28 17:22:53.389083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.389047 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:22:53.389083 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.389057 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:22:53.390109 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.390083 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.390212 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.390113 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.390212 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.390124 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.390409 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.390396 2559 policy_none.go:47] "Start" Jul 28 17:22:53.429125 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.428752 2559 manager.go:337] "Starting Device Plugin manager" Jul 28 17:22:53.429125 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.428831 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:22:53.429125 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.428845 2559 server.go:87] "Starting device plugin registration server" Jul 28 17:22:53.429366 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.429190 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:22:53.429366 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.429208 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:22:53.430627 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.429639 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:22:53.430627 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.429723 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:22:53.430627 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.429731 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:22:53.430627 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.430135 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:22:53.430627 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.430208 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.443080 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.443059 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-94.ec2.internal" not found Jul 28 17:22:53.529435 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.529359 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.530825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.530361 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.530825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.530395 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.530825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.530412 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.530825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.530442 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.538010 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.537981 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.538105 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.538017 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-94.ec2.internal\": node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.557512 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.557491 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.561819 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.561788 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:22:53.563229 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.563203 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:22:53.563355 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.563260 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:22:53.563355 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.563288 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:22:53.563355 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.563331 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:22:53.566491 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.566363 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:53.658323 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.658281 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.664474 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.664429 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal"] Jul 28 17:22:53.664548 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.664522 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.665524 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.665507 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.665634 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.665541 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.665634 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.665556 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.667147 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667129 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.667268 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.667321 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667286 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.667932 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667916 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.668013 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667949 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.668013 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667959 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.668013 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.667915 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.668145 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.668026 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.668145 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.668044 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.669324 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.669307 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.669413 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.669338 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:22:53.670055 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.670040 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:22:53.670114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.670072 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:22:53.670114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.670084 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:22:53.671136 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.671117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.671221 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.671146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.671221 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.671180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc29e61c206e5b8484e1a2f844a63c6f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"fc29e61c206e5b8484e1a2f844a63c6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.684844 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.684814 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-94.ec2.internal\" not found" node="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.688940 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.688924 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-94.ec2.internal\" not found" node="ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.758747 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.758697 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.771405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.771405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.771611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc29e61c206e5b8484e1a2f844a63c6f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"fc29e61c206e5b8484e1a2f844a63c6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.771611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc29e61c206e5b8484e1a2f844a63c6f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-94.ec2.internal\" (UID: \"fc29e61c206e5b8484e1a2f844a63c6f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.771611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.771611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.771482 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1243eaaae1973ffde813517e02db4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal\" (UID: \"ab1243eaaae1973ffde813517e02db4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.859025 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.858935 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.959595 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:53.959544 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:53.988099 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.988062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:53.993329 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:53.993308 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:54.060015 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.059978 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.160549 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.160464 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.175380 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.175355 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:54.261446 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.261411 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.283826 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.283795 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:22:54.283990 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.283973 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:22:54.284048 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.283985 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:22:54.284048 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.283985 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:22:54.357262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.357214 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:17:52 +0000 UTC" deadline="2028-05-14 11:52:04.519606168 +0000 UTC" Jul 28 17:22:54.357262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.357251 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15738h29m10.162357961s" Jul 28 17:22:54.362343 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.362324 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.462902 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.462831 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.502181 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:54.502127 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc29e61c206e5b8484e1a2f844a63c6f.slice/crio-aa2f84c350e1c3ba910b38b7b67868f9686c548b87fb04021ffd81da3115eb5c WatchSource:0}: Error finding container aa2f84c350e1c3ba910b38b7b67868f9686c548b87fb04021ffd81da3115eb5c: Status 404 returned error can't find the container with id aa2f84c350e1c3ba910b38b7b67868f9686c548b87fb04021ffd81da3115eb5c Jul 28 17:22:54.505782 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.505767 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:22:54.563636 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.563594 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.566674 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.566631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" event={"ID":"fc29e61c206e5b8484e1a2f844a63c6f","Type":"ContainerStarted","Data":"aa2f84c350e1c3ba910b38b7b67868f9686c548b87fb04021ffd81da3115eb5c"} Jul 28 17:22:54.614593 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:54.614568 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1243eaaae1973ffde813517e02db4e.slice/crio-60dfeeb845e5ab742a13558a69093a25f201b328e5943cf54bef45f7b1bcaa69 WatchSource:0}: Error finding container 60dfeeb845e5ab742a13558a69093a25f201b328e5943cf54bef45f7b1bcaa69: Status 404 returned error can't find the container with id 60dfeeb845e5ab742a13558a69093a25f201b328e5943cf54bef45f7b1bcaa69 Jul 28 17:22:54.663940 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:54.663889 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-94.ec2.internal\" not found" Jul 28 17:22:54.704556 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.704528 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:54.769419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.769344 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" Jul 28 17:22:54.780730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.780706 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:22:54.781590 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.781576 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" Jul 28 17:22:54.787462 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:54.787436 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:22:55.337917 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.337885 2559 apiserver.go:52] "Watching apiserver" Jul 28 17:22:55.343574 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.343549 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:22:55.343963 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.343940 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2xfxg","openshift-ovn-kubernetes/ovnkube-node-zz6kk","kube-system/global-pull-secret-syncer-nfsqz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv","openshift-image-registry/node-ca-fljvm","openshift-multus/multus-additional-cni-plugins-rtjd8","openshift-multus/network-metrics-daemon-kn29b","openshift-network-diagnostics/network-check-target-5wlw5","openshift-network-operator/iptables-alerter-nmj4b","kube-system/konnectivity-agent-qbk5j","kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tt2pl","openshift-dns/node-resolver-2jx5n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal"] Jul 28 17:22:55.345980 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.345588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.345980 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.345663 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:22:55.347038 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.346929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.349345 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.349319 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.349444 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.349415 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:22:55.349708 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.349562 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rp5v4\"" Jul 28 17:22:55.349708 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.349586 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.349708 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.349607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.351628 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.350006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.352342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.351883 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.352342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.352144 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:22:55.352342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.352270 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbp8p\"" Jul 28 17:22:55.352342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.352330 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.352595 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.352575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.354456 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.354031 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.356171 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.356130 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.356834 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.356810 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:22:55.356923 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.356904 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m86cn\"" Jul 28 17:22:55.356975 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.356959 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zqbcx\"" Jul 28 17:22:55.357338 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357087 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:22:55.357338 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.356825 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.357338 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.357485 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:22:55.357485 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:22:55.357485 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357453 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.357664 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357647 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.357831 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357813 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.357975 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.357959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.358236 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.358216 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sbhfs\"" Jul 28 17:22:55.358603 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.358367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:22:55.358603 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.358422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.359585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.359569 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:22:55.359844 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.359828 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.359912 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.359863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wgj8t\"" Jul 28 17:22:55.361565 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.361546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.361828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.361811 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:22:55.361912 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.361838 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:22:55.362412 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.362412 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362295 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:22:55.362412 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362310 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:22:55.362412 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362372 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.362637 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6z56z\"" Jul 28 17:22:55.362827 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.362809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:55.362902 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.362874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:22:55.363335 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.363317 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:22:55.363809 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.363792 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sbkk\"" Jul 28 17:22:55.363938 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.363909 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:22:55.364344 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.364319 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.366278 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.366262 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:22:55.366829 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.366817 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmrw5\"" Jul 28 17:22:55.368396 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.368306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:22:55.368487 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.368474 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:22:55.370443 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.370427 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:22:55.378211 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.378182 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:22:55.380905 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.380905 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-node-log\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-netd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-dbus\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhhk\" (UniqueName: \"kubernetes.io/projected/a3230072-6dbb-4b89-b502-154ffbb738f3-kube-api-access-zkhhk\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.380988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-system-cni-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-sys\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.381031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-os-release\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-etc-kubernetes\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cnibin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-netns\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-kubelet\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d4b66c5-97c4-4415-ab98-be43ecac674a-iptables-alerter-script\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-tuned\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e21d31-d702-42f4-9735-bd86abe4a890-tmp-dir\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.381323 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-bin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-socket-dir-parent\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-k8s-cni-cncf-io\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-sys-fs\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-system-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-var-lib-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-etc-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85sv2\" (UniqueName: \"kubernetes.io/projected/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kube-api-access-85sv2\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-netns\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-run\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-var-lib-kubelet\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.381625 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-socket-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-systemd\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-cnibin\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkqv\" (UniqueName: \"kubernetes.io/projected/97ae91dc-4609-4ecb-beed-663318fd9640-kube-api-access-mzkqv\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zgwl\" (UniqueName: \"kubernetes.io/projected/0d4b66c5-97c4-4415-ab98-be43ecac674a-kube-api-access-2zgwl\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-lib-modules\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cni-binary-copy\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e21d31-d702-42f4-9735-bd86abe4a890-hosts-file\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-kubelet-config\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-registration-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-conf-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-multus-certs\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-kubernetes\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jfxh\" (UniqueName: \"kubernetes.io/projected/10e21d31-d702-42f4-9735-bd86abe4a890-kube-api-access-5jfxh\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-device-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-kubelet\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzwz8\" (UniqueName: \"kubernetes.io/projected/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-kube-api-access-fzwz8\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.381989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80c90d-5c72-42d9-841f-e32cf6d25659-konnectivity-ca\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-ovn\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84893e60-7971-4b1b-bbb8-85bf205028d2-serviceca\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-os-release\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4b66c5-97c4-4415-ab98-be43ecac674a-host-slash\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.382551 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-modprobe-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-host\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-daemon-config\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-script-lib\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvm8\" (UniqueName: \"kubernetes.io/projected/d74ffa94-7523-4210-b403-625929aedee2-kube-api-access-jcvm8\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-conf\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-tmp\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84893e60-7971-4b1b-bbb8-85bf205028d2-host\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-multus\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-hostroot\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-slash\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-env-overrides\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d74ffa94-7523-4210-b403-625929aedee2-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80c90d-5c72-42d9-841f-e32cf6d25659-agent-certs\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.382902 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysconfig\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-log-socket\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qz7\" (UniqueName: \"kubernetes.io/projected/84893e60-7971-4b1b-bbb8-85bf205028d2-kube-api-access-v6qz7\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khz7p\" (UniqueName: \"kubernetes.io/projected/d7892b5d-4165-4a44-a641-49e1eba02ed0-kube-api-access-khz7p\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-systemd-units\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.382981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-systemd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.383001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-bin\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.383571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.383014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-config\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.406348 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.406317 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjt7h" Jul 28 17:22:55.411356 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.411331 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjt7h" Jul 28 17:22:55.483811 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.483784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-env-overrides\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484016 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.483817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d74ffa94-7523-4210-b403-625929aedee2-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484016 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.483841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80c90d-5c72-42d9-841f-e32cf6d25659-agent-certs\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysconfig\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-log-socket\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484255 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qz7\" (UniqueName: \"kubernetes.io/projected/84893e60-7971-4b1b-bbb8-85bf205028d2-kube-api-access-v6qz7\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khz7p\" (UniqueName: \"kubernetes.io/projected/d7892b5d-4165-4a44-a641-49e1eba02ed0-kube-api-access-khz7p\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-systemd-units\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484336 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysconfig\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-systemd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-bin\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-env-overrides\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484619 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-log-socket\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-systemd-units\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-config\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-systemd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-bin\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.484890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-config\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-node-log\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-netd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-dbus\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhhk\" (UniqueName: \"kubernetes.io/projected/a3230072-6dbb-4b89-b502-154ffbb738f3-kube-api-access-zkhhk\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-system-cni-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.484979 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-sys\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-os-release\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485051 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-node-log\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-etc-kubernetes\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485074 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-cni-netd\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-sys\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485111 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cnibin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-netns\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-kubelet\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.485885 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d4b66c5-97c4-4415-ab98-be43ecac674a-iptables-alerter-script\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-tuned\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485204 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-dbus\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e21d31-d702-42f4-9735-bd86abe4a890-tmp-dir\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-bin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-socket-dir-parent\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-k8s-cni-cncf-io\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-sys-fs\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-system-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-var-lib-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-etc-kubernetes\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485360 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-etc-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-etc-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485378 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-system-cni-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85sv2\" (UniqueName: \"kubernetes.io/projected/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kube-api-access-85sv2\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-bin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-netns\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.486648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cnibin\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-netns\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485368 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-os-release\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-kubelet\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485454 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-netns\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.485484 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-socket-dir-parent\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-k8s-cni-cncf-io\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.485548 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:55.985529155 +0000 UTC m=+3.054773029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-sys-fs\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485579 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-system-cni-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-var-lib-openvswitch\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-run\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-var-lib-kubelet\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.487585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-socket-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d4b66c5-97c4-4415-ab98-be43ecac674a-iptables-alerter-script\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.486094 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e21d31-d702-42f4-9735-bd86abe4a890-tmp-dir\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.486192 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.486236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-run\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.485717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-systemd\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-cnibin\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487241 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkqv\" (UniqueName: \"kubernetes.io/projected/97ae91dc-4609-4ecb-beed-663318fd9640-kube-api-access-mzkqv\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zgwl\" (UniqueName: \"kubernetes.io/projected/0d4b66c5-97c4-4415-ab98-be43ecac674a-kube-api-access-2zgwl\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-lib-modules\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cni-binary-copy\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e21d31-d702-42f4-9735-bd86abe4a890-hosts-file\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-kubelet-config\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.488386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-registration-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487476 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-socket-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-conf-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-multus-certs\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-kubernetes\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jfxh\" (UniqueName: \"kubernetes.io/projected/10e21d31-d702-42f4-9735-bd86abe4a890-kube-api-access-5jfxh\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-device-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-kubelet\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzwz8\" (UniqueName: \"kubernetes.io/projected/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-kube-api-access-fzwz8\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80c90d-5c72-42d9-841f-e32cf6d25659-konnectivity-ca\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-ovn\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84893e60-7971-4b1b-bbb8-85bf205028d2-serviceca\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-os-release\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4b66c5-97c4-4415-ab98-be43ecac674a-host-slash\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-modprobe-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-host\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d74ffa94-7523-4210-b403-625929aedee2-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-daemon-config\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-script-lib\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvm8\" (UniqueName: \"kubernetes.io/projected/d74ffa94-7523-4210-b403-625929aedee2-kube-api-access-jcvm8\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487882 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-kubelet\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e31bc2fe-a870-4f63-b199-51a9b3ac623c-kubelet-config\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487982 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-cni-binary-copy\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.487988 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488012 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.486276 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-var-lib-kubelet\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.488082 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:22:55.988052628 +0000 UTC m=+3.057296496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488067 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-lib-modules\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487988 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-systemd\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.489896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488108 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488147 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4b66c5-97c4-4415-ab98-be43ecac674a-host-slash\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488175 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-run-multus-certs\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-kubernetes\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-registration-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.487499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e21d31-d702-42f4-9735-bd86abe4a890-hosts-file\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488272 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-modprobe-d\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-conf\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-tmp\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84893e60-7971-4b1b-bbb8-85bf205028d2-host\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-multus\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-hostroot\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-slash\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488558 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-slash\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488328 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-os-release\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.490814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97ae91dc-4609-4ecb-beed-663318fd9640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488641 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84893e60-7971-4b1b-bbb8-85bf205028d2-host\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488680 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-host-var-lib-cni-multus\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-hostroot\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80c90d-5c72-42d9-841f-e32cf6d25659-konnectivity-ca\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488825 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-host\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488302 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d74ffa94-7523-4210-b403-625929aedee2-run-ovn\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488973 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-tuned\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488989 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97ae91dc-4609-4ecb-beed-663318fd9640-cnibin\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.489053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-conf-dir\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.488303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-device-dir\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.489136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7892b5d-4165-4a44-a641-49e1eba02ed0-etc-sysctl-conf\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.489144 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-multus-daemon-config\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.489406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84893e60-7971-4b1b-bbb8-85bf205028d2-serviceca\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.489573 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d74ffa94-7523-4210-b403-625929aedee2-ovnkube-script-lib\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.490307 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80c90d-5c72-42d9-841f-e32cf6d25659-agent-certs\") pod \"konnectivity-agent-qbk5j\" (UID: \"3f80c90d-5c72-42d9-841f-e32cf6d25659\") " pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.491630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.491349 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7892b5d-4165-4a44-a641-49e1eba02ed0-tmp\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.493510 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.493490 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khz7p\" (UniqueName: \"kubernetes.io/projected/d7892b5d-4165-4a44-a641-49e1eba02ed0-kube-api-access-khz7p\") pod \"tuned-tt2pl\" (UID: \"d7892b5d-4165-4a44-a641-49e1eba02ed0\") " pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.496345 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.496327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhhk\" (UniqueName: \"kubernetes.io/projected/a3230072-6dbb-4b89-b502-154ffbb738f3-kube-api-access-zkhhk\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.498131 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.498092 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:55.498131 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.498115 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:55.498131 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.498129 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:55.498452 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.498228 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:55.998208011 +0000 UTC m=+3.067451886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:55.499909 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.499890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jfxh\" (UniqueName: \"kubernetes.io/projected/10e21d31-d702-42f4-9735-bd86abe4a890-kube-api-access-5jfxh\") pod \"node-resolver-2jx5n\" (UID: \"10e21d31-d702-42f4-9735-bd86abe4a890\") " pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.500485 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.500462 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvm8\" (UniqueName: \"kubernetes.io/projected/d74ffa94-7523-4210-b403-625929aedee2-kube-api-access-jcvm8\") pod \"ovnkube-node-zz6kk\" (UID: \"d74ffa94-7523-4210-b403-625929aedee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.500679 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.500658 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zgwl\" (UniqueName: \"kubernetes.io/projected/0d4b66c5-97c4-4415-ab98-be43ecac674a-kube-api-access-2zgwl\") pod \"iptables-alerter-nmj4b\" (UID: \"0d4b66c5-97c4-4415-ab98-be43ecac674a\") " pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.501115 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.501041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qz7\" (UniqueName: \"kubernetes.io/projected/84893e60-7971-4b1b-bbb8-85bf205028d2-kube-api-access-v6qz7\") pod \"node-ca-fljvm\" (UID: \"84893e60-7971-4b1b-bbb8-85bf205028d2\") " pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.501115 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.501070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkqv\" (UniqueName: \"kubernetes.io/projected/97ae91dc-4609-4ecb-beed-663318fd9640-kube-api-access-mzkqv\") pod \"multus-additional-cni-plugins-rtjd8\" (UID: \"97ae91dc-4609-4ecb-beed-663318fd9640\") " pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.503015 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.501956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85sv2\" (UniqueName: \"kubernetes.io/projected/ccc01a6c-a08f-4d02-8bcc-e0768f0386a9-kube-api-access-85sv2\") pod \"aws-ebs-csi-driver-node-x66wv\" (UID: \"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.503015 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.502556 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzwz8\" (UniqueName: \"kubernetes.io/projected/c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb-kube-api-access-fzwz8\") pod \"multus-2xfxg\" (UID: \"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb\") " pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.510173 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.510125 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:55.568810 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.568774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"ab1243eaaae1973ffde813517e02db4e","Type":"ContainerStarted","Data":"60dfeeb845e5ab742a13558a69093a25f201b328e5943cf54bef45f7b1bcaa69"} Jul 28 17:22:55.607655 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.607593 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:55.661526 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.661490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jx5n" Jul 28 17:22:55.668597 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.668573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" Jul 28 17:22:55.678331 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.678296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fljvm" Jul 28 17:22:55.684938 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.684914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" Jul 28 17:22:55.691848 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.691816 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nmj4b" Jul 28 17:22:55.706310 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.706285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2xfxg" Jul 28 17:22:55.712960 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.712932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:22:55.720832 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.720805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:22:55.725641 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.725607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" Jul 28 17:22:55.992936 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.992855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:55.993097 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:55.992938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:55.993097 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.992977 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:55.993097 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.993031 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:55.993097 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.993038 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:22:56.993020871 +0000 UTC m=+4.062264739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:55.993097 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:55.993061 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:56.99305108 +0000 UTC m=+4.062294937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:56.093674 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.093639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:56.093864 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:56.093807 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:56.093864 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:56.093832 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:56.093864 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:56.093844 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:56.094012 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:56.093898 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:57.093879254 +0000 UTC m=+4.163123108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:56.181223 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.181187 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:22:56.249522 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.249452 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7892b5d_4165_4a44_a641_49e1eba02ed0.slice/crio-b2c8a8c2b660540e519694a9a330b9db449084a849e30ab47f5b50b42dd6e817 WatchSource:0}: Error finding container b2c8a8c2b660540e519694a9a330b9db449084a849e30ab47f5b50b42dd6e817: Status 404 returned error can't find the container with id b2c8a8c2b660540e519694a9a330b9db449084a849e30ab47f5b50b42dd6e817 Jul 28 17:22:56.250848 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.250821 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74ffa94_7523_4210_b403_625929aedee2.slice/crio-1030ba0f564bcef1b60d18a11ac8219fbb52b1dec53db550f43fd8b89218cec0 WatchSource:0}: Error finding container 1030ba0f564bcef1b60d18a11ac8219fbb52b1dec53db550f43fd8b89218cec0: Status 404 returned error can't find the container with id 1030ba0f564bcef1b60d18a11ac8219fbb52b1dec53db550f43fd8b89218cec0 Jul 28 17:22:56.253173 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.253127 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51fb0fd_0ca9_4dd6_a8d0_aba6a5b62fcb.slice/crio-766d1465cdb603cafd4ce5a799d65cd15b8803328a0415735e8b198fedeb56da WatchSource:0}: Error finding container 766d1465cdb603cafd4ce5a799d65cd15b8803328a0415735e8b198fedeb56da: Status 404 returned error can't find the container with id 766d1465cdb603cafd4ce5a799d65cd15b8803328a0415735e8b198fedeb56da Jul 28 17:22:56.254238 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.254146 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc01a6c_a08f_4d02_8bcc_e0768f0386a9.slice/crio-bb0117ad38cbc3c16697bb2886932ec0c4ea4b8c82a8404cb752cf5a43ed185e WatchSource:0}: Error finding container bb0117ad38cbc3c16697bb2886932ec0c4ea4b8c82a8404cb752cf5a43ed185e: Status 404 returned error can't find the container with id bb0117ad38cbc3c16697bb2886932ec0c4ea4b8c82a8404cb752cf5a43ed185e Jul 28 17:22:56.255843 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.255822 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e21d31_d702_42f4_9735_bd86abe4a890.slice/crio-2aed83946cda8fd3be43be9e030f392e65a862fa590541f27c447a712551ac35 WatchSource:0}: Error finding container 2aed83946cda8fd3be43be9e030f392e65a862fa590541f27c447a712551ac35: Status 404 returned error can't find the container with id 2aed83946cda8fd3be43be9e030f392e65a862fa590541f27c447a712551ac35 Jul 28 17:22:56.256795 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.256774 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4b66c5_97c4_4415_ab98_be43ecac674a.slice/crio-b54b6e71fe5813b40405d922ace2b8ff6a44ac398c6a726634ec42bc4192b6ea WatchSource:0}: Error finding container b54b6e71fe5813b40405d922ace2b8ff6a44ac398c6a726634ec42bc4192b6ea: Status 404 returned error can't find the container with id b54b6e71fe5813b40405d922ace2b8ff6a44ac398c6a726634ec42bc4192b6ea Jul 28 17:22:56.257558 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.257534 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84893e60_7971_4b1b_bbb8_85bf205028d2.slice/crio-5ae4e1ba0e52ed4f1760cc853bfa65d084f7b2c9fdce7cf438623ac20932c0b2 WatchSource:0}: Error finding container 5ae4e1ba0e52ed4f1760cc853bfa65d084f7b2c9fdce7cf438623ac20932c0b2: Status 404 returned error can't find the container with id 5ae4e1ba0e52ed4f1760cc853bfa65d084f7b2c9fdce7cf438623ac20932c0b2 Jul 28 17:22:56.258500 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.258379 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f80c90d_5c72_42d9_841f_e32cf6d25659.slice/crio-858fd9497bb9400480ea0b7c23bc062041109969fe74582975169028cd9fea47 WatchSource:0}: Error finding container 858fd9497bb9400480ea0b7c23bc062041109969fe74582975169028cd9fea47: Status 404 returned error can't find the container with id 858fd9497bb9400480ea0b7c23bc062041109969fe74582975169028cd9fea47 Jul 28 17:22:56.259894 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:22:56.259874 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ae91dc_4609_4ecb_beed_663318fd9640.slice/crio-bc274d9dd7d7a0a7411574da289036a42df12f82492934ad2e646a2f07fac53f WatchSource:0}: Error finding container bc274d9dd7d7a0a7411574da289036a42df12f82492934ad2e646a2f07fac53f: Status 404 returned error can't find the container with id bc274d9dd7d7a0a7411574da289036a42df12f82492934ad2e646a2f07fac53f Jul 28 17:22:56.414274 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.414023 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:55 +0000 UTC" deadline="2028-05-02 19:14:03.175841094 +0000 UTC" Jul 28 17:22:56.414274 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.414271 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15457h51m6.761573847s" Jul 28 17:22:56.563972 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.563939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:56.564129 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:56.564102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:22:56.572436 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.572403 2559 generic.go:356] "Generic (PLEG): container finished" podID="ab1243eaaae1973ffde813517e02db4e" containerID="38b0d8bc7fbf2af66b25515ef08c8def128b0655958e6d5cd9d31d7450c8ac69" exitCode=0 Jul 28 17:22:56.572600 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.572492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"ab1243eaaae1973ffde813517e02db4e","Type":"ContainerDied","Data":"38b0d8bc7fbf2af66b25515ef08c8def128b0655958e6d5cd9d31d7450c8ac69"} Jul 28 17:22:56.573904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.573879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerStarted","Data":"bc274d9dd7d7a0a7411574da289036a42df12f82492934ad2e646a2f07fac53f"} Jul 28 17:22:56.575182 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.575133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nmj4b" event={"ID":"0d4b66c5-97c4-4415-ab98-be43ecac674a","Type":"ContainerStarted","Data":"b54b6e71fe5813b40405d922ace2b8ff6a44ac398c6a726634ec42bc4192b6ea"} Jul 28 17:22:56.576529 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.576502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jx5n" event={"ID":"10e21d31-d702-42f4-9735-bd86abe4a890","Type":"ContainerStarted","Data":"2aed83946cda8fd3be43be9e030f392e65a862fa590541f27c447a712551ac35"} Jul 28 17:22:56.577629 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.577610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbk5j" event={"ID":"3f80c90d-5c72-42d9-841f-e32cf6d25659","Type":"ContainerStarted","Data":"858fd9497bb9400480ea0b7c23bc062041109969fe74582975169028cd9fea47"} Jul 28 17:22:56.578734 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.578710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fljvm" event={"ID":"84893e60-7971-4b1b-bbb8-85bf205028d2","Type":"ContainerStarted","Data":"5ae4e1ba0e52ed4f1760cc853bfa65d084f7b2c9fdce7cf438623ac20932c0b2"} Jul 28 17:22:56.579701 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.579682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" event={"ID":"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9","Type":"ContainerStarted","Data":"bb0117ad38cbc3c16697bb2886932ec0c4ea4b8c82a8404cb752cf5a43ed185e"} Jul 28 17:22:56.580558 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.580536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2xfxg" event={"ID":"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb","Type":"ContainerStarted","Data":"766d1465cdb603cafd4ce5a799d65cd15b8803328a0415735e8b198fedeb56da"} Jul 28 17:22:56.581612 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.581582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"1030ba0f564bcef1b60d18a11ac8219fbb52b1dec53db550f43fd8b89218cec0"} Jul 28 17:22:56.582620 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.582604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" event={"ID":"d7892b5d-4165-4a44-a641-49e1eba02ed0","Type":"ContainerStarted","Data":"b2c8a8c2b660540e519694a9a330b9db449084a849e30ab47f5b50b42dd6e817"} Jul 28 17:22:56.583854 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.583831 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" event={"ID":"fc29e61c206e5b8484e1a2f844a63c6f","Type":"ContainerStarted","Data":"66912a35e29d9921dc1e09eeb3dce19ba213ba861daeb874ec3fb14e5fb3f4be"} Jul 28 17:22:56.599061 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:56.598975 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-94.ec2.internal" podStartSLOduration=2.598945535 podStartE2EDuration="2.598945535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:56.598360063 +0000 UTC m=+3.667603938" watchObservedRunningTime="2026-07-28 17:22:56.598945535 +0000 UTC m=+3.668189423" Jul 28 17:22:57.000932 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.000894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:57.001313 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.000963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:57.001313 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.001106 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:57.001313 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.001191 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:22:59.001172961 +0000 UTC m=+6.070416829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:57.001564 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.001545 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:57.001627 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.001598 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:59.001583281 +0000 UTC m=+6.070827139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:57.101723 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.101681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:57.101905 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.101881 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:57.101905 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.101902 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:57.102116 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.101915 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:57.102116 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.101970 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:59.101953447 +0000 UTC m=+6.171197305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:57.415222 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.415106 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:55 +0000 UTC" deadline="2028-03-15 00:51:21.786700372 +0000 UTC" Jul 28 17:22:57.415222 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.415153 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14287h28m24.371559638s" Jul 28 17:22:57.564324 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.564292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:57.564487 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.564429 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:22:57.566302 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.566278 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:57.566447 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:57.566384 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:22:57.600494 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:57.600460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" event={"ID":"ab1243eaaae1973ffde813517e02db4e","Type":"ContainerStarted","Data":"25fc92f72e9695e1cb0dcf145f423eb313ac4f02c3d1b46bae3a50b23dab247d"} Jul 28 17:22:58.563969 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:58.563922 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:58.564787 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:58.564034 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:22:59.019460 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:59.019367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:59.019460 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:59.019443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:22:59.019693 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.019568 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:59.019693 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.019635 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:23:03.019615011 +0000 UTC m=+10.088858884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:22:59.020073 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.020052 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:59.020218 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.020113 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:03.02009659 +0000 UTC m=+10.089340462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:22:59.120408 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:59.120363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:59.120627 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.120594 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:22:59.120627 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.120622 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:22:59.120750 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.120637 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:59.120750 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.120702 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:03.120680737 +0000 UTC m=+10.189924596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:22:59.566206 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:59.566153 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:22:59.566685 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.566309 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:22:59.566685 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:22:59.566646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:22:59.566783 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:22:59.566734 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:00.563708 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:00.563676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:00.563919 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:00.563787 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:01.565690 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:01.565606 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:01.566072 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:01.565607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:01.566072 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:01.565751 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:01.566072 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:01.565822 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:02.563935 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:02.563900 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:02.564152 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:02.564039 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:03.056925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:03.057000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.057103 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.057100 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.057193 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:23:11.057154577 +0000 UTC m=+18.126398443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:03.057660 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.057213 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:11.057203414 +0000 UTC m=+18.126447284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:03.158222 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:03.158182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:03.158397 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.158365 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:23:03.158397 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.158387 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:23:03.158513 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.158399 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:03.158513 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.158459 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:11.158439417 +0000 UTC m=+18.227683286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:03.566770 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:03.566742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:03.567879 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.567844 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:03.568116 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:03.568088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:03.568400 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:03.568359 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:04.564112 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:04.564028 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:04.564605 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:04.564177 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:05.563596 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:05.563567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:05.563738 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:05.563567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:05.563738 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:05.563695 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:05.563835 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:05.563752 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:06.564377 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:06.564334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:06.564732 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:06.564443 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:07.564004 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:07.563956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:07.564004 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:07.563990 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:07.564239 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:07.564101 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:07.564315 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:07.564259 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:08.563831 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:08.563787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:08.564368 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:08.563910 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:09.563599 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:09.563568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:09.563773 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:09.563568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:09.563773 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:09.563712 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:09.563906 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:09.563777 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:10.563774 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:10.563736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:10.564006 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:10.563881 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:11.122678 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:11.122581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:11.122678 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:11.122660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:11.122914 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.122774 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:11.122914 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.122775 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:11.122914 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.122842 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:23:27.122820734 +0000 UTC m=+34.192064592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:11.122914 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.122858 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:27.122850553 +0000 UTC m=+34.192094409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:11.223022 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:11.222978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:11.223231 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.223206 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:23:11.223307 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.223235 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:23:11.223307 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.223249 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:11.223400 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.223316 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:27.223296092 +0000 UTC m=+34.292539952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:11.563865 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:11.563828 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:11.563865 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:11.563852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:11.564428 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.563974 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:11.564511 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:11.564459 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:12.564353 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:12.564313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:12.564752 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:12.564442 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:13.567213 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:13.567185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:13.567213 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:13.567212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:13.567724 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:13.567295 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:13.567724 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:13.567424 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:14.564600 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:14.564553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:14.564887 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:14.564704 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:15.567613 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.567433 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:15.568373 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.567493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:15.568373 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:15.567820 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:15.568373 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:15.567686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:15.649218 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.649181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jx5n" event={"ID":"10e21d31-d702-42f4-9735-bd86abe4a890","Type":"ContainerStarted","Data":"c4c2daa823454b3420d97a352dfc6f193b6f90e776ab7d157e1fb4c946159ce5"} Jul 28 17:23:15.650759 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.650727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbk5j" event={"ID":"3f80c90d-5c72-42d9-841f-e32cf6d25659","Type":"ContainerStarted","Data":"8a6cf349c9d1a2daa1cc731569d6923d3abd2ff2c33a9cfa2f2521ab12542263"} Jul 28 17:23:15.652357 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.652320 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fljvm" event={"ID":"84893e60-7971-4b1b-bbb8-85bf205028d2","Type":"ContainerStarted","Data":"7ed8282b38d1bb23ceeb5efb9d7207c44d5b1da49221808b33f4f27c3d495fb2"} Jul 28 17:23:15.654036 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.654003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" event={"ID":"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9","Type":"ContainerStarted","Data":"06fed61ac25eff5f2f78c24ac28a265324a9c5ad9e32c5b205e87afb24400008"} Jul 28 17:23:15.655568 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.655542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2xfxg" event={"ID":"c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb","Type":"ContainerStarted","Data":"d9d52ea3638283b9baa078d0d1b204d4b6fb1ab623505350ee90931de6e834b0"} Jul 28 17:23:15.658209 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.658184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"2a0bb531557737532a5867371fdbbb0e3f59f504d98b34010961a4b00da39117"} Jul 28 17:23:15.658335 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.658259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"5f326f8dd4ea554ce87295d0a08544e188fc9e5ca6bc76608b3b657e9cd265e1"} Jul 28 17:23:15.658335 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.658308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"24677eb85f714bbc42234d766d32327de4d4647847552bc8ce5e1d4eededf779"} Jul 28 17:23:15.658448 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.658355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"b92962846582b48c501f7bfcda2184a42cb50d61d82b8f826dc6380199f192e4"} Jul 28 17:23:15.659679 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.659651 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" event={"ID":"d7892b5d-4165-4a44-a641-49e1eba02ed0","Type":"ContainerStarted","Data":"a3777c500d68d15cb4316a853a14c0afc9ed4b082d802f2a51ebe2b339f64209"} Jul 28 17:23:15.661311 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.661288 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="e9b2702d30a9d5f9d09b3c148dd11e2a14efb7a71616af1980d6c1e1331ac7e2" exitCode=0 Jul 28 17:23:15.661438 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.661322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"e9b2702d30a9d5f9d09b3c148dd11e2a14efb7a71616af1980d6c1e1331ac7e2"} Jul 28 17:23:15.664289 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.664251 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2jx5n" podStartSLOduration=3.767306461 podStartE2EDuration="22.664236175s" totalImagesPullingTime="18.896929714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:15.664111004 +0000 UTC m=+22.733354882" watchObservedRunningTime="2026-07-28 17:23:15.664236175 +0000 UTC m=+22.733480053" Jul 28 17:23:15.664377 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.664327 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-94.ec2.internal" podStartSLOduration=21.664317103 podStartE2EDuration="21.664317103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:57.617245238 +0000 UTC m=+4.686489113" watchObservedRunningTime="2026-07-28 17:23:15.664317103 +0000 UTC m=+22.733560980" Jul 28 17:23:15.699840 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.699790 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2xfxg" podStartSLOduration=3.557441924 podStartE2EDuration="22.699772527s" totalImagesPullingTime="19.142330603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:15.684723818 +0000 UTC m=+22.753967719" watchObservedRunningTime="2026-07-28 17:23:15.699772527 +0000 UTC m=+22.769016405" Jul 28 17:23:15.700389 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.700361 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qbk5j" podStartSLOduration=8.121441952 podStartE2EDuration="22.700347609s" totalImagesPullingTime="14.578905657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:15.699563979 +0000 UTC m=+22.768807855" watchObservedRunningTime="2026-07-28 17:23:15.700347609 +0000 UTC m=+22.769591519" Jul 28 17:23:15.716742 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.716685 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fljvm" podStartSLOduration=3.82172149 podStartE2EDuration="22.716667247s" totalImagesPullingTime="18.894945757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:15.716007379 +0000 UTC m=+22.785251240" watchObservedRunningTime="2026-07-28 17:23:15.716667247 +0000 UTC m=+22.785911125" Jul 28 17:23:15.758436 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:15.758394 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tt2pl" podStartSLOduration=3.853033472 podStartE2EDuration="22.758378383s" totalImagesPullingTime="18.905344911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:15.758328595 +0000 UTC m=+22.827572473" watchObservedRunningTime="2026-07-28 17:23:15.758378383 +0000 UTC m=+22.827622260" Jul 28 17:23:16.564039 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.564007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:16.564343 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:16.564106 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:16.667311 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.667279 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"70daab344e2df1bdc58a05d5fdc0691f3d17aa34a226c36107669643b65b3aff"} Jul 28 17:23:16.667785 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.667350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"5aef99394902fdb4096a438726cbf5aa179cc90b5c63f4d8db0b0918a42a955b"} Jul 28 17:23:16.669081 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.669027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nmj4b" event={"ID":"0d4b66c5-97c4-4415-ab98-be43ecac674a","Type":"ContainerStarted","Data":"d410d6cf5408f1daefb2bff584772f1932fe08e44682a378a91efa0d8871c6b7"} Jul 28 17:23:16.684359 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.684303 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nmj4b" podStartSLOduration=4.803165144 podStartE2EDuration="23.684285031s" totalImagesPullingTime="18.881119887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:16.683619798 +0000 UTC m=+23.752863679" watchObservedRunningTime="2026-07-28 17:23:16.684285031 +0000 UTC m=+23.753528958" Jul 28 17:23:16.708905 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:16.708870 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 17:23:17.440776 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.440666 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:23:16.708893284Z","UUID":"01633d2b-9ccd-4534-bf66-88179103ef9b","Handler":null,"Name":"","Endpoint":""} Jul 28 17:23:17.442981 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.442556 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 17:23:17.442981 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.442604 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 17:23:17.563660 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.563616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:17.563837 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:17.563778 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:17.563837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.563831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:17.564003 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:17.563944 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:17.649073 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.649024 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:23:17.649872 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.649705 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:23:17.673814 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.673744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" event={"ID":"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9","Type":"ContainerStarted","Data":"dce7544f8248ed88c29b7edfd8ab123fff5dd2ae4c082d60dbecd575e582f445"} Jul 28 17:23:17.674419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.674387 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:23:17.674726 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:17.674710 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qbk5j" Jul 28 17:23:18.563854 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:18.563813 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:18.564101 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:18.563924 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:18.678992 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:18.678952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" event={"ID":"ccc01a6c-a08f-4d02-8bcc-e0768f0386a9","Type":"ContainerStarted","Data":"014e012d12c4dab45ace64017572a2254c6ded3164c0bbbb88c0ef1407e72515"} Jul 28 17:23:18.682949 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:18.682907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"7af59f931981d4785a9062326df47450c49ef6cb9c6cf7fb3b3323fed665748e"} Jul 28 17:23:18.696923 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:18.696860 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x66wv" podStartSLOduration=4.55895157 podStartE2EDuration="25.696841443s" totalImagesPullingTime="21.137889873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:18.696146099 +0000 UTC m=+25.765389977" watchObservedRunningTime="2026-07-28 17:23:18.696841443 +0000 UTC m=+25.766085321" Jul 28 17:23:19.568169 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:19.568137 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:19.568169 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:19.568150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:19.568435 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:19.568272 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:19.568435 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:19.568389 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:20.564201 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.563951 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:20.564773 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:20.564296 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:20.691974 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.691935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" event={"ID":"d74ffa94-7523-4210-b403-625929aedee2","Type":"ContainerStarted","Data":"f3fc6a91afb9c071892a896f6642387c20b8202e4848b5639c500bf281f4f8d6"} Jul 28 17:23:20.692261 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.692222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:20.692379 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.692305 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:20.692379 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.692365 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:20.694386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.694363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerStarted","Data":"7a906fb6600ee6a2c979a4a9ae1d9ac4db18b4d53dc3e2c9477511918e72b53a"} Jul 28 17:23:20.710141 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.710119 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:20.710264 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.710253 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:20.726815 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:20.726768 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" podStartSLOduration=8.774687575 podStartE2EDuration="27.72675163s" totalImagesPullingTime="18.952064055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:20.726665629 +0000 UTC m=+27.795909507" watchObservedRunningTime="2026-07-28 17:23:20.72675163 +0000 UTC m=+27.795995490" Jul 28 17:23:21.567007 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:21.566979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:21.567606 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:21.566980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:21.567606 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:21.567068 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:21.567606 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:21.567147 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:21.698082 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:21.698048 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="7a906fb6600ee6a2c979a4a9ae1d9ac4db18b4d53dc3e2c9477511918e72b53a" exitCode=0 Jul 28 17:23:21.698267 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:21.698135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"7a906fb6600ee6a2c979a4a9ae1d9ac4db18b4d53dc3e2c9477511918e72b53a"} Jul 28 17:23:22.564239 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:22.564207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:22.564473 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:22.564307 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:23.564837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:23.564651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:23.565325 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:23.564750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:23.565325 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:23.564906 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:23.565325 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:23.565049 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:23.707483 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:23.707446 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="8c253c89fbf492a558cf8133745498cf077c495e509982034691eb19d277ba7c" exitCode=0 Jul 28 17:23:23.707483 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:23.707486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"8c253c89fbf492a558cf8133745498cf077c495e509982034691eb19d277ba7c"} Jul 28 17:23:24.564388 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:24.564348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:24.564592 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:24.564481 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:25.566517 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:25.566489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:25.566883 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:25.566583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:25.566883 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:25.566631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:25.566883 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:25.566718 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:25.715090 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:25.715060 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="099a17756510717654b67844ad6ba21530089d3f6cf587a672724b01decd0945" exitCode=0 Jul 28 17:23:25.715280 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:25.715134 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"099a17756510717654b67844ad6ba21530089d3f6cf587a672724b01decd0945"} Jul 28 17:23:26.564007 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:26.563970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:26.564221 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:26.564104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:27.136012 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:27.135965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:27.136483 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:27.136064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:27.136483 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.136142 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:27.136483 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.136192 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:27.136483 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.136249 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret podName:e31bc2fe-a870-4f63-b199-51a9b3ac623c nodeName:}" failed. No retries permitted until 2026-07-28 17:23:59.136224202 +0000 UTC m=+66.205468060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret") pod "global-pull-secret-syncer-nfsqz" (UID: "e31bc2fe-a870-4f63-b199-51a9b3ac623c") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:23:27.136483 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.136270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs podName:a3230072-6dbb-4b89-b502-154ffbb738f3 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:59.136258917 +0000 UTC m=+66.205502773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs") pod "network-metrics-daemon-kn29b" (UID: "a3230072-6dbb-4b89-b502-154ffbb738f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:23:27.237114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:27.237074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:27.237300 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.237241 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:23:27.237300 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.237264 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:23:27.237300 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.237276 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qpxnf for pod openshift-network-diagnostics/network-check-target-5wlw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:27.237463 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.237341 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf podName:ee056c84-e60a-4018-950e-7ec90602b554 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:59.237319891 +0000 UTC m=+66.306563757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpxnf" (UniqueName: "kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf") pod "network-check-target-5wlw5" (UID: "ee056c84-e60a-4018-950e-7ec90602b554") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:23:27.570661 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:27.570610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:27.570833 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:27.570620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:27.570833 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.570747 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:27.570833 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:27.570820 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:28.563713 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:28.563680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:28.564251 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:28.563808 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:29.563731 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:29.563682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:29.563731 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:29.563725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:29.564298 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:29.563807 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:29.564298 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:29.563870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:29.728193 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:29.728140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerStarted","Data":"75d5ecebbe9d898af0df3fd45008481bf7a42c429afbbb5a34164660cf9c5286"} Jul 28 17:23:30.563766 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:30.563728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:30.564151 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:30.563836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:30.733283 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:30.733251 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="75d5ecebbe9d898af0df3fd45008481bf7a42c429afbbb5a34164660cf9c5286" exitCode=0 Jul 28 17:23:30.733466 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:30.733315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"75d5ecebbe9d898af0df3fd45008481bf7a42c429afbbb5a34164660cf9c5286"} Jul 28 17:23:31.563748 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:31.563707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:31.563901 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:31.563728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:31.563901 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:31.563829 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:31.563901 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:31.563884 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:31.739045 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:31.739007 2559 generic.go:356] "Generic (PLEG): container finished" podID="97ae91dc-4609-4ecb-beed-663318fd9640" containerID="c1d22b3786d5cdf8a608a96b472b0e1abdb1d6dbead3a81d18b2da7766ae3de0" exitCode=0 Jul 28 17:23:31.739263 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:31.739055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerDied","Data":"c1d22b3786d5cdf8a608a96b472b0e1abdb1d6dbead3a81d18b2da7766ae3de0"} Jul 28 17:23:32.563655 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:32.563614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:32.563847 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:32.563727 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:32.744381 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:32.744344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" event={"ID":"97ae91dc-4609-4ecb-beed-663318fd9640","Type":"ContainerStarted","Data":"246dda5da800c1bb472508850073845fadde65812086de62a5614339093e3b93"} Jul 28 17:23:32.776704 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:32.776651 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rtjd8" podStartSLOduration=9.680322216 podStartE2EDuration="39.776634282s" totalImagesPullingTime="30.096312066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:32.776500562 +0000 UTC m=+39.845744441" watchObservedRunningTime="2026-07-28 17:23:32.776634282 +0000 UTC m=+39.845878159" Jul 28 17:23:33.565259 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:33.565125 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:33.566003 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:33.565220 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:33.566003 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:33.565755 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:33.566353 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:33.566327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:34.564400 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.564206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:34.564875 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:34.564510 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:34.570568 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.570488 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfsqz"] Jul 28 17:23:34.574139 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.574107 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kn29b"] Jul 28 17:23:34.574466 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.574443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:34.574604 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:34.574575 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:34.574905 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.574886 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5wlw5"] Jul 28 17:23:34.575133 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.575116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:34.575384 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:34.575359 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:34.749458 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:34.749428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:34.749647 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:34.749529 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:36.563668 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:36.563623 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:36.564098 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:36.563675 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:36.564098 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:36.563720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:36.564098 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:36.563736 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:36.564098 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:36.563803 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:36.564098 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:36.563877 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:38.563561 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:38.563512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:38.563561 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:38.563561 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:38.564136 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:38.563612 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:38.564136 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:38.563628 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5wlw5" podUID="ee056c84-e60a-4018-950e-7ec90602b554" Jul 28 17:23:38.564136 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:38.563694 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqz" podUID="e31bc2fe-a870-4f63-b199-51a9b3ac623c" Jul 28 17:23:38.564136 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:38.563807 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn29b" podUID="a3230072-6dbb-4b89-b502-154ffbb738f3" Jul 28 17:23:39.244395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.244357 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-94.ec2.internal" event="NodeReady" Jul 28 17:23:39.244585 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.244509 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 17:23:39.297959 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.297931 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmzwb"] Jul 28 17:23:39.328733 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.328698 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlv2r"] Jul 28 17:23:39.328882 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.328815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.331432 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.331403 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 17:23:39.331599 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.331488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pshjr\"" Jul 28 17:23:39.331599 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.331508 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 17:23:39.342845 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.342822 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmzwb"] Jul 28 17:23:39.342963 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.342867 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mgxtn"] Jul 28 17:23:39.342963 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.342942 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.346594 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.346572 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 17:23:39.346720 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.346604 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 17:23:39.346720 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.346645 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 17:23:39.346837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.346823 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2tr\"" Jul 28 17:23:39.346904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.346890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 17:23:39.358659 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.358636 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlv2r"] Jul 28 17:23:39.358769 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.358673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgxtn"] Jul 28 17:23:39.358769 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.358749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.361120 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.361102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 17:23:39.361333 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.361319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 17:23:39.361568 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.361554 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 17:23:39.361942 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.361929 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5f6s9\"" Jul 28 17:23:39.425563 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.425530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-metrics-tls\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.425790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.425594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxjws\" (UniqueName: \"kubernetes.io/projected/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-kube-api-access-cxjws\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.425790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.425733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-tmp-dir\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.425790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.425778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-config-volume\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526183 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxjws\" (UniqueName: \"kubernetes.io/projected/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-kube-api-access-cxjws\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526183 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-tmp-dir\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526183 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-data-volume\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.526405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qd8t\" (UniqueName: \"kubernetes.io/projected/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-api-access-2qd8t\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.526405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-config-volume\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.526405 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwtp9\" (UniqueName: \"kubernetes.io/projected/7da1954a-99fd-4005-87c3-e595474b533e-kube-api-access-gwtp9\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.526598 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-crio-socket\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.526598 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.526598 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-metrics-tls\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526598 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526469 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-tmp-dir\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.526598 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da1954a-99fd-4005-87c3-e595474b533e-cert\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.526904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.526885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-config-volume\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.530915 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.530891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-metrics-tls\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.537436 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.537416 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxjws\" (UniqueName: \"kubernetes.io/projected/6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06-kube-api-access-cxjws\") pod \"dns-default-hmzwb\" (UID: \"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06\") " pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.627395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-data-volume\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.627395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qd8t\" (UniqueName: \"kubernetes.io/projected/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-api-access-2qd8t\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwtp9\" (UniqueName: \"kubernetes.io/projected/7da1954a-99fd-4005-87c3-e595474b533e-kube-api-access-gwtp9\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-crio-socket\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da1954a-99fd-4005-87c3-e595474b533e-cert\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-crio-socket\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.627844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-data-volume\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.628114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.628057 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.630063 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.630046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.630199 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.630183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da1954a-99fd-4005-87c3-e595474b533e-cert\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.635860 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.635840 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qd8t\" (UniqueName: \"kubernetes.io/projected/a0bb0e18-7fbe-4861-96c9-42a06e9b69d5-kube-api-access-2qd8t\") pod \"insights-runtime-extractor-vlv2r\" (UID: \"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5\") " pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.636275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.636259 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwtp9\" (UniqueName: \"kubernetes.io/projected/7da1954a-99fd-4005-87c3-e595474b533e-kube-api-access-gwtp9\") pod \"ingress-canary-mgxtn\" (UID: \"7da1954a-99fd-4005-87c3-e595474b533e\") " pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.640045 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.640025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:39.651205 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.651182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlv2r" Jul 28 17:23:39.666261 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.666235 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgxtn" Jul 28 17:23:39.889934 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.889896 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmzwb"] Jul 28 17:23:39.892437 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.892409 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlv2r"] Jul 28 17:23:39.894659 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:39.894633 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc3ac6b_bb0b_4c02_8bbf_c6436510ae06.slice/crio-586f6466a6e45b5c772bed3c7ca285be8748d17827cd6c0296c731d4ee3fb6e2 WatchSource:0}: Error finding container 586f6466a6e45b5c772bed3c7ca285be8748d17827cd6c0296c731d4ee3fb6e2: Status 404 returned error can't find the container with id 586f6466a6e45b5c772bed3c7ca285be8748d17827cd6c0296c731d4ee3fb6e2 Jul 28 17:23:39.895580 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:39.895546 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bb0e18_7fbe_4861_96c9_42a06e9b69d5.slice/crio-85bb79cb0941abff153a308b8031ccea244e1d43fb87f6347b1c1c695773c042 WatchSource:0}: Error finding container 85bb79cb0941abff153a308b8031ccea244e1d43fb87f6347b1c1c695773c042: Status 404 returned error can't find the container with id 85bb79cb0941abff153a308b8031ccea244e1d43fb87f6347b1c1c695773c042 Jul 28 17:23:39.900994 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:39.900971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgxtn"] Jul 28 17:23:39.904052 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:39.904030 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da1954a_99fd_4005_87c3_e595474b533e.slice/crio-440a4b61bd632519046ea77d0363bf5105a70e282ca80950f53dd6f3b38a7637 WatchSource:0}: Error finding container 440a4b61bd632519046ea77d0363bf5105a70e282ca80950f53dd6f3b38a7637: Status 404 returned error can't find the container with id 440a4b61bd632519046ea77d0363bf5105a70e282ca80950f53dd6f3b38a7637 Jul 28 17:23:40.414231 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.414194 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-x8lp5"] Jul 28 17:23:40.424064 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.424035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:23:40.428150 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.428124 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 17:23:40.428406 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.428388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n5jth\"" Jul 28 17:23:40.428615 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.428597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 17:23:40.438567 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.438537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-x8lp5"] Jul 28 17:23:40.537906 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.537858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgg7f\" (UniqueName: \"kubernetes.io/projected/f34fed2d-6573-41db-b59a-d5672e500099-kube-api-access-pgg7f\") pod \"downloads-7c97dc4555-x8lp5\" (UID: \"f34fed2d-6573-41db-b59a-d5672e500099\") " pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:23:40.563534 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.563499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:40.563955 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.563929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:40.564444 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.564401 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.566689 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.567048 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.567267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.567439 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.567606 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ssq7\"" Jul 28 17:23:40.568085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.567756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r6c5r\"" Jul 28 17:23:40.638479 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.638436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgg7f\" (UniqueName: \"kubernetes.io/projected/f34fed2d-6573-41db-b59a-d5672e500099-kube-api-access-pgg7f\") pod \"downloads-7c97dc4555-x8lp5\" (UID: \"f34fed2d-6573-41db-b59a-d5672e500099\") " pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:23:40.661703 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.661466 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgg7f\" (UniqueName: \"kubernetes.io/projected/f34fed2d-6573-41db-b59a-d5672e500099-kube-api-access-pgg7f\") pod \"downloads-7c97dc4555-x8lp5\" (UID: \"f34fed2d-6573-41db-b59a-d5672e500099\") " pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:23:40.741137 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.741103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:23:40.774535 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.774407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmzwb" event={"ID":"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06","Type":"ContainerStarted","Data":"586f6466a6e45b5c772bed3c7ca285be8748d17827cd6c0296c731d4ee3fb6e2"} Jul 28 17:23:40.776397 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.776327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgxtn" event={"ID":"7da1954a-99fd-4005-87c3-e595474b533e","Type":"ContainerStarted","Data":"440a4b61bd632519046ea77d0363bf5105a70e282ca80950f53dd6f3b38a7637"} Jul 28 17:23:40.778509 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.778433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlv2r" event={"ID":"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5","Type":"ContainerStarted","Data":"85bb79cb0941abff153a308b8031ccea244e1d43fb87f6347b1c1c695773c042"} Jul 28 17:23:40.939596 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:40.938981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-x8lp5"] Jul 28 17:23:40.942220 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:40.942187 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34fed2d_6573_41db_b59a_d5672e500099.slice/crio-2bed64943a64e2cf61cc7248e92ba48509ec6793048edaba65a6ebb8631c3abc WatchSource:0}: Error finding container 2bed64943a64e2cf61cc7248e92ba48509ec6793048edaba65a6ebb8631c3abc: Status 404 returned error can't find the container with id 2bed64943a64e2cf61cc7248e92ba48509ec6793048edaba65a6ebb8631c3abc Jul 28 17:23:41.782669 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:41.782629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-x8lp5" event={"ID":"f34fed2d-6573-41db-b59a-d5672e500099","Type":"ContainerStarted","Data":"2bed64943a64e2cf61cc7248e92ba48509ec6793048edaba65a6ebb8631c3abc"} Jul 28 17:23:46.871019 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.870983 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6nfsz"] Jul 28 17:23:46.899230 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.898264 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6nfsz"] Jul 28 17:23:46.899230 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.898391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902235 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902266 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902278 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902266 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h45fw\"" Jul 28 17:23:46.902735 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:46.902565 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 17:23:47.087593 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.087556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.087780 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.087663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.087780 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.087708 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.087856 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.087785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbh7w\" (UniqueName: \"kubernetes.io/projected/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-kube-api-access-mbh7w\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.188086 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.188053 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.188262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.188105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.188262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.188187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbh7w\" (UniqueName: \"kubernetes.io/projected/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-kube-api-access-mbh7w\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.188262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.188221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.188837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.188815 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.192139 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.192114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.192248 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.192122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.201264 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.201230 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbh7w\" (UniqueName: \"kubernetes.io/projected/3a0a7ab8-f19a-4cbf-a2a1-9074941f9973-kube-api-access-mbh7w\") pod \"prometheus-operator-84d69f794d-6nfsz\" (UID: \"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.212851 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.212827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" Jul 28 17:23:47.761787 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.761543 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6nfsz"] Jul 28 17:23:47.769386 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:47.769242 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0a7ab8_f19a_4cbf_a2a1_9074941f9973.slice/crio-42622f84758938d71b7571757114f96274c18e2d3162c6f085931ce38e41c32f WatchSource:0}: Error finding container 42622f84758938d71b7571757114f96274c18e2d3162c6f085931ce38e41c32f: Status 404 returned error can't find the container with id 42622f84758938d71b7571757114f96274c18e2d3162c6f085931ce38e41c32f Jul 28 17:23:47.800251 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.800126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" event={"ID":"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973","Type":"ContainerStarted","Data":"42622f84758938d71b7571757114f96274c18e2d3162c6f085931ce38e41c32f"} Jul 28 17:23:47.802825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.801914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlv2r" event={"ID":"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5","Type":"ContainerStarted","Data":"a2625474d8415bad5b4813029cca615bb12b5f82e0e1886b91efd2ee6e474aa0"} Jul 28 17:23:47.804006 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.803983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmzwb" event={"ID":"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06","Type":"ContainerStarted","Data":"cef476354d477c1012d60c96443cd411d099affec7be359389d5d3d84caa197c"} Jul 28 17:23:47.806035 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.805570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgxtn" event={"ID":"7da1954a-99fd-4005-87c3-e595474b533e","Type":"ContainerStarted","Data":"7214c3e4eab8d1ad7e0718dd0fdf2c56cee1eae4c63fd4f06c3ce035f761e86d"} Jul 28 17:23:47.823006 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:47.822903 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mgxtn" podStartSLOduration=1.136240366 podStartE2EDuration="8.822883504s" totalImagesPullingTime="7.686643138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:47.821886324 +0000 UTC m=+54.891130215" watchObservedRunningTime="2026-07-28 17:23:47.822883504 +0000 UTC m=+54.892127381" Jul 28 17:23:48.814432 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:48.814388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmzwb" event={"ID":"6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06","Type":"ContainerStarted","Data":"fd030e5f033a7cddc95162306c7779e8d282df16a09654232c345b98e8fe7c4b"} Jul 28 17:23:48.815403 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:48.814467 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmzwb" Jul 28 17:23:48.842550 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:48.842348 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmzwb" podStartSLOduration=2.146133465 podStartE2EDuration="9.842326013s" totalImagesPullingTime="7.696192548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:48.84151707 +0000 UTC m=+55.910760948" watchObservedRunningTime="2026-07-28 17:23:48.842326013 +0000 UTC m=+55.911569895" Jul 28 17:23:49.818252 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.818186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" event={"ID":"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973","Type":"ContainerStarted","Data":"6a3f0a170feff36dcb12c701c85344eb66d0a403dcac72dc62bd8449862336f3"} Jul 28 17:23:49.922713 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.922680 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:23:49.930254 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.929845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:49.932319 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.932289 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 17:23:49.932445 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.932360 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 17:23:49.933095 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.933074 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 17:23:49.933228 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.933074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 17:23:49.933228 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.933196 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 17:23:49.933355 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.933229 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qxqz5\"" Jul 28 17:23:49.936961 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:49.936907 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:23:50.012609 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.012609 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.012851 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx84r\" (UniqueName: \"kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.012851 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012708 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.012851 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.012851 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.012799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.113742 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.113742 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.113742 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx84r\" (UniqueName: \"kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.114020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.114020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.114020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.113807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.115297 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.115268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.115429 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.115270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.116008 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.115969 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.118028 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.118003 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.118147 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.118052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.125059 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.125033 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx84r\" (UniqueName: \"kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r\") pod \"console-7d764c68-p22t4\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:50.241664 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:50.241360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:23:51.941355 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:51.941273 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:23:51.944910 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:23:51.944866 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbe9e5a_397f_4a3f_bd47_026421455dea.slice/crio-2a1974f6a32b8c7885bd4cf97148df632ef22ab7d83fe7a7f6d0282ff7bd21c1 WatchSource:0}: Error finding container 2a1974f6a32b8c7885bd4cf97148df632ef22ab7d83fe7a7f6d0282ff7bd21c1: Status 404 returned error can't find the container with id 2a1974f6a32b8c7885bd4cf97148df632ef22ab7d83fe7a7f6d0282ff7bd21c1 Jul 28 17:23:52.721443 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:52.721403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6kk" Jul 28 17:23:52.831275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:52.831233 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" event={"ID":"3a0a7ab8-f19a-4cbf-a2a1-9074941f9973","Type":"ContainerStarted","Data":"73fe0ba477d8b748a5ef3afd8c765d44072c73bed4d56d7ea591936827543a6e"} Jul 28 17:23:52.833286 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:52.833258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d764c68-p22t4" event={"ID":"adbe9e5a-397f-4a3f-bd47-026421455dea","Type":"ContainerStarted","Data":"2a1974f6a32b8c7885bd4cf97148df632ef22ab7d83fe7a7f6d0282ff7bd21c1"} Jul 28 17:23:52.836022 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:52.835968 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlv2r" event={"ID":"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5","Type":"ContainerStarted","Data":"1edbba8ecce0194f44f48e5a8a948b2999a70095ad08a21ab26b59b8c9ac369d"} Jul 28 17:23:55.282496 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.282410 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-6nfsz" podStartSLOduration=7.577568517 podStartE2EDuration="9.282273013s" totalImagesPullingTime="1.704704496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:52.853604569 +0000 UTC m=+59.922848446" watchObservedRunningTime="2026-07-28 17:23:55.282273013 +0000 UTC m=+62.351516892" Jul 28 17:23:55.283308 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.283287 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-47qjl"] Jul 28 17:23:55.285783 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.285761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.288828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.288801 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 17:23:55.289235 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.289212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 17:23:55.289511 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.289484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j8m7x\"" Jul 28 17:23:55.289580 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.289508 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 17:23:55.362712 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-metrics-client-ca\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.362712 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.362954 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-wtmp\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.362954 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8bn\" (UniqueName: \"kubernetes.io/projected/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-kube-api-access-hd8bn\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.362954 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-sys\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.362954 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.363245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.362993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-textfile\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.363245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.363029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-root\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.363245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.363082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464182 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8bn\" (UniqueName: \"kubernetes.io/projected/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-kube-api-access-hd8bn\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464369 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-sys\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464369 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464369 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-textfile\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464369 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-root\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464369 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-metrics-client-ca\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-wtmp\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-root\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-sys\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464644 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.464618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-wtmp\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.464917 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:55.464675 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 17:23:55.464917 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:23:55.464732 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls podName:7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:55.964711039 +0000 UTC m=+63.033954933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls") pod "node-exporter-47qjl" (UID: "7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70") : secret "node-exporter-tls" not found Jul 28 17:23:55.465256 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.465219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-textfile\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.465374 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.465275 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.465474 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.465434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-metrics-client-ca\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.467968 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.467948 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.477970 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.477943 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8bn\" (UniqueName: \"kubernetes.io/projected/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-kube-api-access-hd8bn\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.968994 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.968952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:55.971734 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:55.971701 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70-node-exporter-tls\") pod \"node-exporter-47qjl\" (UID: \"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70\") " pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:56.197070 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:56.197024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47qjl" Jul 28 17:23:57.216063 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.216016 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp"] Jul 28 17:23:57.221808 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.221781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.224675 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.224647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tbrbl\"" Jul 28 17:23:57.224837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.224653 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 17:23:57.224837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.224656 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fqsc8ih32muri\"" Jul 28 17:23:57.224997 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.224977 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 17:23:57.225128 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.225062 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 17:23:57.225482 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.225315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 17:23:57.225482 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.225320 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 17:23:57.231639 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.231615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp"] Jul 28 17:23:57.281957 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.281913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.281978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82e8340-05dd-4133-8e48-0ec7fe620769-metrics-client-ca\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282104 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-grpc-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlrtr\" (UniqueName: \"kubernetes.io/projected/f82e8340-05dd-4133-8e48-0ec7fe620769-kube-api-access-jlrtr\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282481 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.282481 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.282327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.383694 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.383655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82e8340-05dd-4133-8e48-0ec7fe620769-metrics-client-ca\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.383888 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.383718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.383888 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.383747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-grpc-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.383881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlrtr\" (UniqueName: \"kubernetes.io/projected/f82e8340-05dd-4133-8e48-0ec7fe620769-kube-api-access-jlrtr\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.383968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384119 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.384027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384119 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.384075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384253 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.384117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.384660 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.384551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82e8340-05dd-4133-8e48-0ec7fe620769-metrics-client-ca\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.387212 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.387182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.387325 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.387239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.387325 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.387307 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.387449 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.387326 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.388128 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.388099 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-thanos-querier-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.388268 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.388220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f82e8340-05dd-4133-8e48-0ec7fe620769-secret-grpc-tls\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.394780 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.394754 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlrtr\" (UniqueName: \"kubernetes.io/projected/f82e8340-05dd-4133-8e48-0ec7fe620769-kube-api-access-jlrtr\") pod \"thanos-querier-6bdd7f977c-sjgdp\" (UID: \"f82e8340-05dd-4133-8e48-0ec7fe620769\") " pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:57.533855 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:57.533802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:23:58.313373 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.313326 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:23:58.336255 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.336223 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.345222 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.345138 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:23:58.347543 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.347515 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 17:23:58.393767 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.393944 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.393944 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxsww\" (UniqueName: \"kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.393944 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.394082 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.394082 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.393989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.394082 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.394027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495496 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495496 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxsww\" (UniqueName: \"kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.495828 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.495723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.496475 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.496442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.496634 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.496608 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.496940 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.496642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.496940 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.496609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.498510 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.498490 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.499207 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.499180 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.509025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.508993 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxsww\" (UniqueName: \"kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww\") pod \"console-745f9c5756-vbbhs\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:58.648153 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:58.648059 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:23:59.202611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.202567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:59.202821 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.202631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:59.205174 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.205133 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:23:59.205295 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.205250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:23:59.215774 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.215741 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3230072-6dbb-4b89-b502-154ffbb738f3-metrics-certs\") pod \"network-metrics-daemon-kn29b\" (UID: \"a3230072-6dbb-4b89-b502-154ffbb738f3\") " pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:59.215900 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.215748 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e31bc2fe-a870-4f63-b199-51a9b3ac623c-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqz\" (UID: \"e31bc2fe-a870-4f63-b199-51a9b3ac623c\") " pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:59.304071 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.304029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:59.306835 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.306812 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:23:59.317701 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.317677 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:23:59.328867 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.328837 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxnf\" (UniqueName: \"kubernetes.io/projected/ee056c84-e60a-4018-950e-7ec90602b554-kube-api-access-qpxnf\") pod \"network-check-target-5wlw5\" (UID: \"ee056c84-e60a-4018-950e-7ec90602b554\") " pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:59.478536 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.478455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqz" Jul 28 17:23:59.490058 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.490020 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ssq7\"" Jul 28 17:23:59.497628 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.497586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r6c5r\"" Jul 28 17:23:59.497834 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.497738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn29b" Jul 28 17:23:59.506047 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.506019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:23:59.824079 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:23:59.824048 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmzwb" Jul 28 17:24:01.749731 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.749693 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:24:01.787715 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.787665 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:24:01.821750 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.821711 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:24:01.821913 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.821864 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930015 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.929970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930231 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930231 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930231 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930231 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930462 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwmz\" (UniqueName: \"kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:01.930462 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:01.930317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.031819 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.031705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwmz\" (UniqueName: \"kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.031819 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.031807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.032089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.031900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.032089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.031933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.032089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.031955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.032089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.032008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.032089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.032054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.033023 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.032958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.033023 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.033012 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.033226 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.033148 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.033386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.033336 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.035662 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.034957 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.035662 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.035606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.064518 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.064485 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwmz\" (UniqueName: \"kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz\") pod \"console-54fc5b887d-z297q\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.133592 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.132876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:02.136894 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.136857 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecc0e0f_708f_4f9c_aa87_1eba4f4fdd70.slice/crio-9abf9e68fc9debd17bffc9e25b04ec3c877dab142fcd6be6fdc667e46d82e3d4 WatchSource:0}: Error finding container 9abf9e68fc9debd17bffc9e25b04ec3c877dab142fcd6be6fdc667e46d82e3d4: Status 404 returned error can't find the container with id 9abf9e68fc9debd17bffc9e25b04ec3c877dab142fcd6be6fdc667e46d82e3d4 Jul 28 17:24:02.352731 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.352698 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:24:02.359529 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.359497 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4169b3_f011_4102_8b71_96528b6d02b6.slice/crio-8b0945398ce77ce1664b4562b527e81fe277bf4822c662d489e9ff3f8633375c WatchSource:0}: Error finding container 8b0945398ce77ce1664b4562b527e81fe277bf4822c662d489e9ff3f8633375c: Status 404 returned error can't find the container with id 8b0945398ce77ce1664b4562b527e81fe277bf4822c662d489e9ff3f8633375c Jul 28 17:24:02.360710 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.360634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5wlw5"] Jul 28 17:24:02.366061 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.366035 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee056c84_e60a_4018_950e_7ec90602b554.slice/crio-8e1eeebd25af47c8e99c9696ed58d545a9051810236815bb40185fd5c069e180 WatchSource:0}: Error finding container 8e1eeebd25af47c8e99c9696ed58d545a9051810236815bb40185fd5c069e180: Status 404 returned error can't find the container with id 8e1eeebd25af47c8e99c9696ed58d545a9051810236815bb40185fd5c069e180 Jul 28 17:24:02.431782 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.431745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kn29b"] Jul 28 17:24:02.435217 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.435191 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:24:02.435599 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.435576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3230072_6dbb_4b89_b502_154ffbb738f3.slice/crio-4f5e21408b240460f4d82407c8a114cca4739d646d387c3a24de03c0cbe3b32c WatchSource:0}: Error finding container 4f5e21408b240460f4d82407c8a114cca4739d646d387c3a24de03c0cbe3b32c: Status 404 returned error can't find the container with id 4f5e21408b240460f4d82407c8a114cca4739d646d387c3a24de03c0cbe3b32c Jul 28 17:24:02.439115 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.439085 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa7202c_497a_4a7b_9c6e_0a52423b3254.slice/crio-0f4861d7d7e8184b0a95c06cfc2e02f486e433e4b90a8e984923cf6e85346e19 WatchSource:0}: Error finding container 0f4861d7d7e8184b0a95c06cfc2e02f486e433e4b90a8e984923cf6e85346e19: Status 404 returned error can't find the container with id 0f4861d7d7e8184b0a95c06cfc2e02f486e433e4b90a8e984923cf6e85346e19 Jul 28 17:24:02.596065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.595962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfsqz"] Jul 28 17:24:02.601272 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.601240 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31bc2fe_a870_4f63_b199_51a9b3ac623c.slice/crio-d32dc0906cbb7e60113192d88618fbd75271662337de3a12cf7e5880b1ab0586 WatchSource:0}: Error finding container d32dc0906cbb7e60113192d88618fbd75271662337de3a12cf7e5880b1ab0586: Status 404 returned error can't find the container with id d32dc0906cbb7e60113192d88618fbd75271662337de3a12cf7e5880b1ab0586 Jul 28 17:24:02.607203 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.607174 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp"] Jul 28 17:24:02.610633 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:24:02.610601 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82e8340_05dd_4133_8e48_0ec7fe620769.slice/crio-e2e533ba3c54f3ff1b4e04d2db0c00d6ad39fd78d6ba183e2b1e6fac8e79838b WatchSource:0}: Error finding container e2e533ba3c54f3ff1b4e04d2db0c00d6ad39fd78d6ba183e2b1e6fac8e79838b: Status 404 returned error can't find the container with id e2e533ba3c54f3ff1b4e04d2db0c00d6ad39fd78d6ba183e2b1e6fac8e79838b Jul 28 17:24:02.885935 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.885570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-x8lp5" event={"ID":"f34fed2d-6573-41db-b59a-d5672e500099","Type":"ContainerStarted","Data":"57fcebaef2adf7f91373a0011a3da86003b6198fae507cef2a9fdfcd5f7c9b5b"} Jul 28 17:24:02.885935 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.885852 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:24:02.888919 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.888842 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc5b887d-z297q" event={"ID":"9aa7202c-497a-4a7b-9c6e-0a52423b3254","Type":"ContainerStarted","Data":"0f4861d7d7e8184b0a95c06cfc2e02f486e433e4b90a8e984923cf6e85346e19"} Jul 28 17:24:02.890554 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.890524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f9c5756-vbbhs" event={"ID":"ea4169b3-f011-4102-8b71-96528b6d02b6","Type":"ContainerStarted","Data":"8b0945398ce77ce1664b4562b527e81fe277bf4822c662d489e9ff3f8633375c"} Jul 28 17:24:02.894125 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.894038 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47qjl" event={"ID":"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70","Type":"ContainerStarted","Data":"9abf9e68fc9debd17bffc9e25b04ec3c877dab142fcd6be6fdc667e46d82e3d4"} Jul 28 17:24:02.895954 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.895921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfsqz" event={"ID":"e31bc2fe-a870-4f63-b199-51a9b3ac623c","Type":"ContainerStarted","Data":"d32dc0906cbb7e60113192d88618fbd75271662337de3a12cf7e5880b1ab0586"} Jul 28 17:24:02.898058 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.897974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"e2e533ba3c54f3ff1b4e04d2db0c00d6ad39fd78d6ba183e2b1e6fac8e79838b"} Jul 28 17:24:02.900546 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.900517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-x8lp5" Jul 28 17:24:02.902582 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.902556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5wlw5" event={"ID":"ee056c84-e60a-4018-950e-7ec90602b554","Type":"ContainerStarted","Data":"8e1eeebd25af47c8e99c9696ed58d545a9051810236815bb40185fd5c069e180"} Jul 28 17:24:02.908120 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.908071 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-x8lp5" podStartSLOduration=1.692255192 podStartE2EDuration="22.908056316s" totalImagesPullingTime="21.215801124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:02.905868143 +0000 UTC m=+69.975112024" watchObservedRunningTime="2026-07-28 17:24:02.908056316 +0000 UTC m=+69.977300193" Jul 28 17:24:02.911181 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.910351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlv2r" event={"ID":"a0bb0e18-7fbe-4861-96c9-42a06e9b69d5","Type":"ContainerStarted","Data":"068468463b23d21b86835c858cf5dd49e5968f7001eeca5a40ffcf46d8d4250c"} Jul 28 17:24:02.912487 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.912462 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn29b" event={"ID":"a3230072-6dbb-4b89-b502-154ffbb738f3","Type":"ContainerStarted","Data":"4f5e21408b240460f4d82407c8a114cca4739d646d387c3a24de03c0cbe3b32c"} Jul 28 17:24:02.956037 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:02.952894 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlv2r" podStartSLOduration=1.891325825 podStartE2EDuration="23.95287128s" totalImagesPullingTime="22.061545455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:23:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:02.952855545 +0000 UTC m=+70.022099423" watchObservedRunningTime="2026-07-28 17:24:02.95287128 +0000 UTC m=+70.022115161" Jul 28 17:24:14.991130 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.991087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc5b887d-z297q" event={"ID":"9aa7202c-497a-4a7b-9c6e-0a52423b3254","Type":"ContainerStarted","Data":"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187"} Jul 28 17:24:14.993013 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.992985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f9c5756-vbbhs" event={"ID":"ea4169b3-f011-4102-8b71-96528b6d02b6","Type":"ContainerStarted","Data":"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157"} Jul 28 17:24:14.994861 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.994832 2559 generic.go:356] "Generic (PLEG): container finished" podID="7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70" containerID="bfdf56ba54c1e4168495239d14a6f12d771e7d6615f9f11e892963b6cb692af8" exitCode=0 Jul 28 17:24:14.994987 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.994906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47qjl" event={"ID":"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70","Type":"ContainerDied","Data":"bfdf56ba54c1e4168495239d14a6f12d771e7d6615f9f11e892963b6cb692af8"} Jul 28 17:24:14.996601 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.996571 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfsqz" event={"ID":"e31bc2fe-a870-4f63-b199-51a9b3ac623c","Type":"ContainerStarted","Data":"a8a9f63153310ebbb95afa0065bc1494ab0aa185e5e6650f7b79d2d261741b27"} Jul 28 17:24:14.998353 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:14.998322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d764c68-p22t4" event={"ID":"adbe9e5a-397f-4a3f-bd47-026421455dea","Type":"ContainerStarted","Data":"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f"} Jul 28 17:24:15.000774 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.000751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"800aa4f3df675e536d5e588e5783e38c3d661bfcfa6249fc2c4df95b13414877"} Jul 28 17:24:15.000892 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.000804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"c91ff3b7a1b35feb27a5872558b5b300f7ff34f09296410988292dc01e9257c5"} Jul 28 17:24:15.000892 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.000837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"f2f5f77fa35d787dbef882cbd08e5b2b0180c7f75417b2c96b167fd5931398c1"} Jul 28 17:24:15.002615 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.002590 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5wlw5" event={"ID":"ee056c84-e60a-4018-950e-7ec90602b554","Type":"ContainerStarted","Data":"0af460a08d59439d70b64dba5f50d9a59a30008b9022565d285cd8e7332c6ed3"} Jul 28 17:24:15.002725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.002705 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:24:15.007108 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.007081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn29b" event={"ID":"a3230072-6dbb-4b89-b502-154ffbb738f3","Type":"ContainerStarted","Data":"e21f516b42ca282b13dca5adcac2c549f409f873b634c99df60954e7e7a7a493"} Jul 28 17:24:15.007239 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.007134 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn29b" event={"ID":"a3230072-6dbb-4b89-b502-154ffbb738f3","Type":"ContainerStarted","Data":"74d8f09ac9549b7716092564d8b7f1f55f1c9ccea09836f30bfca8a284bca112"} Jul 28 17:24:15.011532 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.011476 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fc5b887d-z297q" podStartSLOduration=2.638226378 podStartE2EDuration="14.011457246s" totalImagesPullingTime="11.373230868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.011117924 +0000 UTC m=+82.080361803" watchObservedRunningTime="2026-07-28 17:24:15.011457246 +0000 UTC m=+82.080701102" Jul 28 17:24:15.027218 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.027153 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5wlw5" podStartSLOduration=70.569421887 podStartE2EDuration="1m22.027135639s" totalImagesPullingTime="11.457713752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.02611786 +0000 UTC m=+82.095361738" watchObservedRunningTime="2026-07-28 17:24:15.027135639 +0000 UTC m=+82.096379496" Jul 28 17:24:15.043270 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.043215 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nfsqz" podStartSLOduration=70.807539274 podStartE2EDuration="1m22.0431978s" totalImagesPullingTime="11.235658526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.042226807 +0000 UTC m=+82.111470682" watchObservedRunningTime="2026-07-28 17:24:15.0431978 +0000 UTC m=+82.112441675" Jul 28 17:24:15.060748 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.060701 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d764c68-p22t4" podStartSLOduration=4.169088969 podStartE2EDuration="26.060684364s" totalImagesPullingTime="21.891595395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.060461346 +0000 UTC m=+82.129705225" watchObservedRunningTime="2026-07-28 17:24:15.060684364 +0000 UTC m=+82.129928242" Jul 28 17:24:15.101818 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.101556 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745f9c5756-vbbhs" podStartSLOduration=5.620560733 podStartE2EDuration="17.101538557s" totalImagesPullingTime="11.480977824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.100567693 +0000 UTC m=+82.169811598" watchObservedRunningTime="2026-07-28 17:24:15.101538557 +0000 UTC m=+82.170782434" Jul 28 17:24:15.117984 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:15.117934 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kn29b" podStartSLOduration=70.84339413 podStartE2EDuration="1m22.117917685s" totalImagesPullingTime="11.274523555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:15.116308979 +0000 UTC m=+82.185552857" watchObservedRunningTime="2026-07-28 17:24:15.117917685 +0000 UTC m=+82.187161564" Jul 28 17:24:16.013571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.013535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47qjl" event={"ID":"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70","Type":"ContainerStarted","Data":"00bf5d5b18945824346e5676ed4b1b9e708a559b9bb1fb311df0c6fb4bea45f3"} Jul 28 17:24:16.014115 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.013604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47qjl" event={"ID":"7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70","Type":"ContainerStarted","Data":"5106808d2010bee37d675dfb61682743d77019a58196de7611a92557fb88c7c7"} Jul 28 17:24:16.016569 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.016536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"4b999f5bb228f47d473ce554df74e5d86375698132d763300c5d674fafe335ba"} Jul 28 17:24:16.016710 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.016615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"ef4fc80585624f0f3ca3867a2db6e096312e87377339c51cf4b47980a6462af9"} Jul 28 17:24:16.016710 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.016659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" event={"ID":"f82e8340-05dd-4133-8e48-0ec7fe620769","Type":"ContainerStarted","Data":"5e1caf6c999c2caa3f96a6f243d4f7a789c57eaabf2d8c38ff1fc0ae33f88d9f"} Jul 28 17:24:16.037400 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.037337 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-47qjl" podStartSLOduration=9.315927023 podStartE2EDuration="21.037320365s" totalImagesPullingTime="11.572909342s" totalInitContainerRuntime="148.484ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:16.035519456 +0000 UTC m=+83.104763334" watchObservedRunningTime="2026-07-28 17:24:16.037320365 +0000 UTC m=+83.106564242" Jul 28 17:24:16.059447 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:16.059379 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" podStartSLOduration=6.626687691 podStartE2EDuration="19.059354949s" totalImagesPullingTime="12.432667258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:16.058005436 +0000 UTC m=+83.127249313" watchObservedRunningTime="2026-07-28 17:24:16.059354949 +0000 UTC m=+83.128598828" Jul 28 17:24:17.023081 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:17.023047 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:24:18.648246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:18.648201 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:18.648683 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:18.648267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:18.653347 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:18.653322 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:19.036721 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:19.036693 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:20.242520 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:20.242478 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:24:22.133797 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:22.133759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:22.134220 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:22.133838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:22.138767 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:22.138742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:23.033154 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:23.033128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bdd7f977c-sjgdp" Jul 28 17:24:23.050700 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:23.050674 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:24:23.126339 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:23.126305 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:24:40.019630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.019583 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d764c68-p22t4" podUID="adbe9e5a-397f-4a3f-bd47-026421455dea" containerName="console" containerID="cri-o://86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f" gracePeriod=15 Jul 28 17:24:40.307704 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.307620 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:24:40.368213 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368146 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368398 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368227 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368398 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368257 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368398 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368317 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368398 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368350 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368398 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368395 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx84r\" (UniqueName: \"kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r\") pod \"adbe9e5a-397f-4a3f-bd47-026421455dea\" (UID: \"adbe9e5a-397f-4a3f-bd47-026421455dea\") " Jul 28 17:24:40.368746 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368713 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:40.368746 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368725 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config" (OuterVolumeSpecName: "console-config") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:40.368746 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.368723 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca" (OuterVolumeSpecName: "service-ca") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:40.370672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.370650 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:24:40.370798 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.370776 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:24:40.370840 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.370807 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r" (OuterVolumeSpecName: "kube-api-access-hx84r") pod "adbe9e5a-397f-4a3f-bd47-026421455dea" (UID: "adbe9e5a-397f-4a3f-bd47-026421455dea"). InnerVolumeSpecName "kube-api-access-hx84r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:24:40.469135 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469095 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-console-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:40.469135 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469127 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-service-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:40.469135 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469137 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx84r\" (UniqueName: \"kubernetes.io/projected/adbe9e5a-397f-4a3f-bd47-026421455dea-kube-api-access-hx84r\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:40.469135 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469147 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-oauth-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:40.469411 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469174 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adbe9e5a-397f-4a3f-bd47-026421455dea-oauth-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:40.469411 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:40.469185 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adbe9e5a-397f-4a3f-bd47-026421455dea-console-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:41.114938 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.114896 2559 generic.go:356] "Generic (PLEG): container finished" podID="adbe9e5a-397f-4a3f-bd47-026421455dea" containerID="86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f" exitCode=0 Jul 28 17:24:41.115376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.114951 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d764c68-p22t4" Jul 28 17:24:41.115376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.114977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d764c68-p22t4" event={"ID":"adbe9e5a-397f-4a3f-bd47-026421455dea","Type":"ContainerDied","Data":"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f"} Jul 28 17:24:41.115376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.115030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d764c68-p22t4" event={"ID":"adbe9e5a-397f-4a3f-bd47-026421455dea","Type":"ContainerDied","Data":"2a1974f6a32b8c7885bd4cf97148df632ef22ab7d83fe7a7f6d0282ff7bd21c1"} Jul 28 17:24:41.115376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.115057 2559 scope.go:117] "RemoveContainer" containerID="86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f" Jul 28 17:24:41.133614 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.133594 2559 scope.go:117] "RemoveContainer" containerID="86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f" Jul 28 17:24:41.133940 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:24:41.133921 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f\": container with ID starting with 86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f not found: ID does not exist" containerID="86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f" Jul 28 17:24:41.134061 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.133951 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f"} err="failed to get container status \"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f\": rpc error: code = NotFound desc = could not find container \"86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f\": container with ID starting with 86db24e45e7dd0a262eb5327ee94989b5e75b352dc0166bc6351b3f288a21b1f not found: ID does not exist" Jul 28 17:24:41.135820 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.135796 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:24:41.139825 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.139795 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d764c68-p22t4"] Jul 28 17:24:41.568919 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:41.568885 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adbe9e5a-397f-4a3f-bd47-026421455dea" path="/var/lib/kubelet/pods/adbe9e5a-397f-4a3f-bd47-026421455dea/volumes" Jul 28 17:24:46.019856 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:46.019825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5wlw5" Jul 28 17:24:48.146308 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.146262 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-745f9c5756-vbbhs" podUID="ea4169b3-f011-4102-8b71-96528b6d02b6" containerName="console" containerID="cri-o://f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157" gracePeriod=15 Jul 28 17:24:48.417309 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.417253 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:48.430088 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430058 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430098 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430116 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430131 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxsww\" (UniqueName: \"kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430176 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430210 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430241 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca\") pod \"ea4169b3-f011-4102-8b71-96528b6d02b6\" (UID: \"ea4169b3-f011-4102-8b71-96528b6d02b6\") " Jul 28 17:24:48.430673 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430630 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:48.430673 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430654 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config" (OuterVolumeSpecName: "console-config") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:48.431010 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430753 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:48.431010 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.430843 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:48.432558 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.432528 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww" (OuterVolumeSpecName: "kube-api-access-hxsww") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "kube-api-access-hxsww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:24:48.432558 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.432538 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:24:48.432675 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.432614 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea4169b3-f011-4102-8b71-96528b6d02b6" (UID: "ea4169b3-f011-4102-8b71-96528b6d02b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:24:48.531061 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531030 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-console-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531061 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531056 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531069 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-service-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531080 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-oauth-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531093 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4169b3-f011-4102-8b71-96528b6d02b6-console-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531104 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4169b3-f011-4102-8b71-96528b6d02b6-oauth-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:48.531275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:48.531116 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxsww\" (UniqueName: \"kubernetes.io/projected/ea4169b3-f011-4102-8b71-96528b6d02b6-kube-api-access-hxsww\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:24:49.144290 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.144255 2559 generic.go:356] "Generic (PLEG): container finished" podID="ea4169b3-f011-4102-8b71-96528b6d02b6" containerID="f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157" exitCode=0 Jul 28 17:24:49.144480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.144307 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745f9c5756-vbbhs" Jul 28 17:24:49.144480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.144343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f9c5756-vbbhs" event={"ID":"ea4169b3-f011-4102-8b71-96528b6d02b6","Type":"ContainerDied","Data":"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157"} Jul 28 17:24:49.144480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.144399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745f9c5756-vbbhs" event={"ID":"ea4169b3-f011-4102-8b71-96528b6d02b6","Type":"ContainerDied","Data":"8b0945398ce77ce1664b4562b527e81fe277bf4822c662d489e9ff3f8633375c"} Jul 28 17:24:49.144480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.144420 2559 scope.go:117] "RemoveContainer" containerID="f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157" Jul 28 17:24:49.152906 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.152725 2559 scope.go:117] "RemoveContainer" containerID="f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157" Jul 28 17:24:49.153112 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:24:49.152984 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157\": container with ID starting with f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157 not found: ID does not exist" containerID="f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157" Jul 28 17:24:49.153112 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.153009 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157"} err="failed to get container status \"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157\": rpc error: code = NotFound desc = could not find container \"f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157\": container with ID starting with f358cf6eeae86c8459ae784b5369279d21bd49c0751c036ebb0a91ad05ab6157 not found: ID does not exist" Jul 28 17:24:49.167019 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.165265 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:24:49.168945 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.168926 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745f9c5756-vbbhs"] Jul 28 17:24:49.567643 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:24:49.567612 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4169b3-f011-4102-8b71-96528b6d02b6" path="/var/lib/kubelet/pods/ea4169b3-f011-4102-8b71-96528b6d02b6/volumes" Jul 28 17:25:18.153941 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.153893 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:18.154974 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.154946 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbe9e5a-397f-4a3f-bd47-026421455dea" containerName="console" Jul 28 17:25:18.155089 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.155077 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbe9e5a-397f-4a3f-bd47-026421455dea" containerName="console" Jul 28 17:25:18.155150 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.155095 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4169b3-f011-4102-8b71-96528b6d02b6" containerName="console" Jul 28 17:25:18.155150 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.155103 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4169b3-f011-4102-8b71-96528b6d02b6" containerName="console" Jul 28 17:25:18.155275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.155241 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4169b3-f011-4102-8b71-96528b6d02b6" containerName="console" Jul 28 17:25:18.155275 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.155255 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="adbe9e5a-397f-4a3f-bd47-026421455dea" containerName="console" Jul 28 17:25:18.158563 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.158540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.161043 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161019 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 17:25:18.161197 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161059 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 17:25:18.161197 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161135 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 17:25:18.161197 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161178 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 17:25:18.161535 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 17:25:18.161589 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161576 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 17:25:18.161642 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7kvhh\"" Jul 28 17:25:18.161642 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161600 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 17:25:18.161642 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.161604 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 17:25:18.167433 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.167410 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 17:25:18.173788 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.173763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:18.230393 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230393 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-out\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230671 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230918 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230918 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230918 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230918 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nznw\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-kube-api-access-4nznw\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.230918 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.230836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-web-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331417 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331417 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nznw\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-kube-api-access-4nznw\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-web-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331603 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-out\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.331698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.332153 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.332153 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.331750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.333024 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.332997 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.333818 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.333792 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e82086f-1a25-4f09-b169-b98ef06fc0c7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.334797 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.334774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.334797 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.334781 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.334957 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.334845 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-out\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.334957 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.334940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.335180 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.335143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-web-config\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.335385 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.335350 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e82086f-1a25-4f09-b169-b98ef06fc0c7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.335385 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.335373 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.335550 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.335532 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.336362 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.336343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.336945 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.336924 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e82086f-1a25-4f09-b169-b98ef06fc0c7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.340345 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.340326 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nznw\" (UniqueName: \"kubernetes.io/projected/7e82086f-1a25-4f09-b169-b98ef06fc0c7-kube-api-access-4nznw\") pod \"alertmanager-main-0\" (UID: \"7e82086f-1a25-4f09-b169-b98ef06fc0c7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.468889 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.468803 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:25:18.614500 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:18.614473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:25:18.617085 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:25:18.617039 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e82086f_1a25_4f09_b169_b98ef06fc0c7.slice/crio-6177a745a61cdc63dc0873f68a3cdd5c9fe4edef6d3fce06a6efe5a0462b75c2 WatchSource:0}: Error finding container 6177a745a61cdc63dc0873f68a3cdd5c9fe4edef6d3fce06a6efe5a0462b75c2: Status 404 returned error can't find the container with id 6177a745a61cdc63dc0873f68a3cdd5c9fe4edef6d3fce06a6efe5a0462b75c2 Jul 28 17:25:19.252044 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.251999 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"6177a745a61cdc63dc0873f68a3cdd5c9fe4edef6d3fce06a6efe5a0462b75c2"} Jul 28 17:25:19.659255 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.659224 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8486f74bfd-8nw4m"] Jul 28 17:25:19.663074 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.662284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.666188 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666022 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 17:25:19.666188 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666026 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 17:25:19.666447 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 17:25:19.666447 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666427 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 17:25:19.666666 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666591 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c6twk\"" Jul 28 17:25:19.666843 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.666817 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 17:25:19.674215 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.674189 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 17:25:19.678445 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.678394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8486f74bfd-8nw4m"] Jul 28 17:25:19.744236 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v8lk\" (UniqueName: \"kubernetes.io/projected/f7ca54bf-9474-427a-a2b2-5678266ead37-kube-api-access-4v8lk\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-federate-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744622 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-serving-certs-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.744622 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.744511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-metrics-client-ca\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.845722 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-federate-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.845722 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.845722 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-serving-certs-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-metrics-client-ca\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v8lk\" (UniqueName: \"kubernetes.io/projected/f7ca54bf-9474-427a-a2b2-5678266ead37-kube-api-access-4v8lk\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.845888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.846784 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.846750 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-serving-certs-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.847068 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.847049 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-metrics-client-ca\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.847232 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.847098 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.848857 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.848835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-federate-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.848957 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.848870 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-telemeter-client-tls\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.849443 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.849420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.849515 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.849437 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7ca54bf-9474-427a-a2b2-5678266ead37-secret-telemeter-client\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.874562 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.874521 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v8lk\" (UniqueName: \"kubernetes.io/projected/f7ca54bf-9474-427a-a2b2-5678266ead37-kube-api-access-4v8lk\") pod \"telemeter-client-8486f74bfd-8nw4m\" (UID: \"f7ca54bf-9474-427a-a2b2-5678266ead37\") " pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:19.975827 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:19.975779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" Jul 28 17:25:20.136959 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:20.136767 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8486f74bfd-8nw4m"] Jul 28 17:25:20.141718 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:25:20.141688 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ca54bf_9474_427a_a2b2_5678266ead37.slice/crio-3467c58feee96db1587deeb382f2973816d7c3ba442c31bb8f74c3d9158523a5 WatchSource:0}: Error finding container 3467c58feee96db1587deeb382f2973816d7c3ba442c31bb8f74c3d9158523a5: Status 404 returned error can't find the container with id 3467c58feee96db1587deeb382f2973816d7c3ba442c31bb8f74c3d9158523a5 Jul 28 17:25:20.257485 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:20.257451 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" event={"ID":"f7ca54bf-9474-427a-a2b2-5678266ead37","Type":"ContainerStarted","Data":"3467c58feee96db1587deeb382f2973816d7c3ba442c31bb8f74c3d9158523a5"} Jul 28 17:25:20.259070 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:20.259042 2559 generic.go:356] "Generic (PLEG): container finished" podID="7e82086f-1a25-4f09-b169-b98ef06fc0c7" containerID="eedb3a864f1f30b772e34a46fda628dedba2c5ac691273afe44cd8b1027ba7cf" exitCode=0 Jul 28 17:25:20.259218 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:20.259094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerDied","Data":"eedb3a864f1f30b772e34a46fda628dedba2c5ac691273afe44cd8b1027ba7cf"} Jul 28 17:25:22.274630 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:22.274547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" event={"ID":"f7ca54bf-9474-427a-a2b2-5678266ead37","Type":"ContainerStarted","Data":"a64c6146c41bd79dc4e3cb3344256695aa308cabb9053bbf232436cf5755cbc8"} Jul 28 17:25:22.276837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:22.276810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"2f075cafa5dde188ddfc5f5c7109cf4056de3a5c4d5564991378261227bb1890"} Jul 28 17:25:23.284146 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.284097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"9ce3df6f835a1c07562aa750cf9410c4adba5090739a154c9c17e157a8d93758"} Jul 28 17:25:23.284672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.284252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"e6dc4dd8b3c395a6592893e5ca0246209cd45da9601079f19fb5bd5974999ea2"} Jul 28 17:25:23.284672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.284287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"9c240130e835bbd05b324dd45f0d1027632232f411c3333f5b08507b21232178"} Jul 28 17:25:23.284672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.284316 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"16b217f494e26589dca79bc180a1650c05527d859108e9ebd834890b84024851"} Jul 28 17:25:23.284672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.284351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e82086f-1a25-4f09-b169-b98ef06fc0c7","Type":"ContainerStarted","Data":"225d77ec5d01b084b7d36dc7a0a049279cb02c3874d428a2a744feb9671c81e9"} Jul 28 17:25:23.286311 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.286282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" event={"ID":"f7ca54bf-9474-427a-a2b2-5678266ead37","Type":"ContainerStarted","Data":"fa1e0027b0061ca46370235c1e1e0ce320e7ca0697600b16510da712e107dd35"} Jul 28 17:25:23.286432 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.286338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" event={"ID":"f7ca54bf-9474-427a-a2b2-5678266ead37","Type":"ContainerStarted","Data":"6c66598ab7bb1229e3e1d823669f438f162b1a92a560db235d4706783f1ebe71"} Jul 28 17:25:23.312360 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.312292 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.438078433 podStartE2EDuration="5.312273641s" totalImagesPullingTime="2.852737921s" totalInitContainerRuntime="21.457287ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:23.310571293 +0000 UTC m=+150.379815170" watchObservedRunningTime="2026-07-28 17:25:23.312273641 +0000 UTC m=+150.381517574" Jul 28 17:25:23.332216 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:23.332134 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8486f74bfd-8nw4m" podStartSLOduration=2.319454294 podStartE2EDuration="4.33210497s" totalImagesPullingTime="2.012650676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:23.330808199 +0000 UTC m=+150.400052117" watchObservedRunningTime="2026-07-28 17:25:23.33210497 +0000 UTC m=+150.401348847" Jul 28 17:25:24.152294 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.152261 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:25:24.154517 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.154500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.170324 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.170297 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:25:24.287574 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49tth\" (UniqueName: \"kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.288050 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.287825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.388834 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.388776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389039 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.388924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49tth\" (UniqueName: \"kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389039 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.388998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389206 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389284 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389284 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389393 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.389942 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.389905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.390247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.390221 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.390593 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.390575 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.392000 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.391973 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.392069 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.392055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.396862 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.396839 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49tth\" (UniqueName: \"kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth\") pod \"console-7bc8ffdb6d-x46l6\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.465666 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.465553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:24.603862 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:24.603818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:25:24.609335 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:25:24.609301 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396a5d6a_de36_4495_a3e7_1daaebcd8b06.slice/crio-44adfda0edd7af4a1cba52ddf8b1f709a9c508e70b265a5f598386e570129735 WatchSource:0}: Error finding container 44adfda0edd7af4a1cba52ddf8b1f709a9c508e70b265a5f598386e570129735: Status 404 returned error can't find the container with id 44adfda0edd7af4a1cba52ddf8b1f709a9c508e70b265a5f598386e570129735 Jul 28 17:25:25.295858 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:25.295826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8ffdb6d-x46l6" event={"ID":"396a5d6a-de36-4495-a3e7-1daaebcd8b06","Type":"ContainerStarted","Data":"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8"} Jul 28 17:25:25.296357 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:25.295877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8ffdb6d-x46l6" event={"ID":"396a5d6a-de36-4495-a3e7-1daaebcd8b06","Type":"ContainerStarted","Data":"44adfda0edd7af4a1cba52ddf8b1f709a9c508e70b265a5f598386e570129735"} Jul 28 17:25:25.313581 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:25.313522 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc8ffdb6d-x46l6" podStartSLOduration=1.313504253 podStartE2EDuration="1.313504253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:25.312462307 +0000 UTC m=+152.381706186" watchObservedRunningTime="2026-07-28 17:25:25.313504253 +0000 UTC m=+152.382748190" Jul 28 17:25:34.466025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:34.465968 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:34.466025 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:34.466046 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:34.471176 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:34.471132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:35.336866 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:35.336838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:25:35.377446 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:25:35.377409 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:26:00.397427 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.397355 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54fc5b887d-z297q" podUID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" containerName="console" containerID="cri-o://00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187" gracePeriod=15 Jul 28 17:26:00.645797 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.645771 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:26:00.695122 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695025 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvwmz\" (UniqueName: \"kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695122 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695107 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695372 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695179 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695372 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695204 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695372 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695248 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695372 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695279 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695372 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695312 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config\") pod \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\" (UID: \"9aa7202c-497a-4a7b-9c6e-0a52423b3254\") " Jul 28 17:26:00.695633 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695606 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:26:00.695633 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695616 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:26:00.695976 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.695955 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config" (OuterVolumeSpecName: "console-config") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:26:00.696273 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.696178 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca" (OuterVolumeSpecName: "service-ca") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:26:00.697805 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.697771 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:26:00.698029 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.698008 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz" (OuterVolumeSpecName: "kube-api-access-tvwmz") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "kube-api-access-tvwmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:26:00.698300 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.698277 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9aa7202c-497a-4a7b-9c6e-0a52423b3254" (UID: "9aa7202c-497a-4a7b-9c6e-0a52423b3254"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:26:00.795972 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.795936 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.795972 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.795965 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-service-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.795972 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.795974 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-oauth-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.795972 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.795983 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvwmz\" (UniqueName: \"kubernetes.io/projected/9aa7202c-497a-4a7b-9c6e-0a52423b3254-kube-api-access-tvwmz\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.796284 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.795992 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.796284 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.796000 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-oauth-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:00.796284 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:00.796010 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa7202c-497a-4a7b-9c6e-0a52423b3254-console-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:26:01.429874 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.429833 2559 generic.go:356] "Generic (PLEG): container finished" podID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" containerID="00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187" exitCode=0 Jul 28 17:26:01.430287 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.429886 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc5b887d-z297q" Jul 28 17:26:01.430287 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.429888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc5b887d-z297q" event={"ID":"9aa7202c-497a-4a7b-9c6e-0a52423b3254","Type":"ContainerDied","Data":"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187"} Jul 28 17:26:01.430287 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.429940 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc5b887d-z297q" event={"ID":"9aa7202c-497a-4a7b-9c6e-0a52423b3254","Type":"ContainerDied","Data":"0f4861d7d7e8184b0a95c06cfc2e02f486e433e4b90a8e984923cf6e85346e19"} Jul 28 17:26:01.430287 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.429968 2559 scope.go:117] "RemoveContainer" containerID="00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187" Jul 28 17:26:01.438960 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.438940 2559 scope.go:117] "RemoveContainer" containerID="00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187" Jul 28 17:26:01.439241 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:26:01.439222 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187\": container with ID starting with 00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187 not found: ID does not exist" containerID="00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187" Jul 28 17:26:01.439282 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.439251 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187"} err="failed to get container status \"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187\": rpc error: code = NotFound desc = could not find container \"00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187\": container with ID starting with 00d0aaed69409bb8db7d116f6ba3adb043efe25c03c42e2c7b0dc7fc3dfdc187 not found: ID does not exist" Jul 28 17:26:01.451647 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.451605 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:26:01.463376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.463348 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54fc5b887d-z297q"] Jul 28 17:26:01.568813 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:01.568781 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" path="/var/lib/kubelet/pods/9aa7202c-497a-4a7b-9c6e-0a52423b3254/volumes" Jul 28 17:26:39.098031 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.097995 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:26:39.098545 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.098289 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" containerName="console" Jul 28 17:26:39.098545 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.098301 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" containerName="console" Jul 28 17:26:39.098545 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.098348 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa7202c-497a-4a7b-9c6e-0a52423b3254" containerName="console" Jul 28 17:26:39.100313 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.100297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.110721 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.110701 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:26:39.198062 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198229 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198229 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198229 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198229 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198384 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9254f\" (UniqueName: \"kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.198384 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.198287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299535 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9254f\" (UniqueName: \"kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299535 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.299725 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.299650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.300420 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.300398 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.300518 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.300474 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.300765 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.300742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.300907 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.300885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.302247 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.302222 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.302342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.302325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.308113 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.308083 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9254f\" (UniqueName: \"kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f\") pod \"console-7f8fb94955-tdmgq\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.408813 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.408726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:39.539468 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.539437 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:26:39.542484 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:26:39.542455 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d340c7_65c5_4f87_a5fa_d93aa8efe0a6.slice/crio-ed2c1387020a467e7d9bd44492ac0832c3c8a97fd744a81e096827400affd121 WatchSource:0}: Error finding container ed2c1387020a467e7d9bd44492ac0832c3c8a97fd744a81e096827400affd121: Status 404 returned error can't find the container with id ed2c1387020a467e7d9bd44492ac0832c3c8a97fd744a81e096827400affd121 Jul 28 17:26:39.569931 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:39.569783 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fb94955-tdmgq" event={"ID":"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6","Type":"ContainerStarted","Data":"ed2c1387020a467e7d9bd44492ac0832c3c8a97fd744a81e096827400affd121"} Jul 28 17:26:40.574816 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:40.574785 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fb94955-tdmgq" event={"ID":"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6","Type":"ContainerStarted","Data":"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064"} Jul 28 17:26:40.593480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:40.593419 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8fb94955-tdmgq" podStartSLOduration=1.5934046099999999 podStartE2EDuration="1.59340461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:26:40.592013554 +0000 UTC m=+227.661257435" watchObservedRunningTime="2026-07-28 17:26:40.59340461 +0000 UTC m=+227.662648488" Jul 28 17:26:49.408976 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:49.408932 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:49.409479 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:49.408998 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:49.413955 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:49.413930 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:49.610387 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:49.610360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:26:49.659662 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:26:49.659580 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:27:14.680455 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.680376 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bc8ffdb6d-x46l6" podUID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" containerName="console" containerID="cri-o://0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8" gracePeriod=15 Jul 28 17:27:14.923142 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.923119 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:27:14.973513 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973431 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973513 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49tth\" (UniqueName: \"kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973513 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973486 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973756 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973531 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973756 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973756 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973601 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.973756 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973710 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config\") pod \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\" (UID: \"396a5d6a-de36-4495-a3e7-1daaebcd8b06\") " Jul 28 17:27:14.974002 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973979 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:27:14.974002 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.973988 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca" (OuterVolumeSpecName: "service-ca") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:27:14.974108 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.974025 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:27:14.974285 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.974234 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config" (OuterVolumeSpecName: "console-config") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:27:14.975862 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.975835 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:27:14.975862 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.975854 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:27:14.976019 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:14.975948 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth" (OuterVolumeSpecName: "kube-api-access-49tth") pod "396a5d6a-de36-4495-a3e7-1daaebcd8b06" (UID: "396a5d6a-de36-4495-a3e7-1daaebcd8b06"). InnerVolumeSpecName "kube-api-access-49tth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:27:15.074650 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074617 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-service-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074650 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074644 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074650 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074655 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-oauth-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074880 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074664 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49tth\" (UniqueName: \"kubernetes.io/projected/396a5d6a-de36-4495-a3e7-1daaebcd8b06-kube-api-access-49tth\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074880 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074674 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396a5d6a-de36-4495-a3e7-1daaebcd8b06-console-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074880 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074682 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-oauth-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.074880 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.074691 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396a5d6a-de36-4495-a3e7-1daaebcd8b06-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:15.701788 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.701754 2559 generic.go:356] "Generic (PLEG): container finished" podID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" containerID="0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8" exitCode=0 Jul 28 17:27:15.702245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.701802 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8ffdb6d-x46l6" Jul 28 17:27:15.702245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.701844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8ffdb6d-x46l6" event={"ID":"396a5d6a-de36-4495-a3e7-1daaebcd8b06","Type":"ContainerDied","Data":"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8"} Jul 28 17:27:15.702245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.701896 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8ffdb6d-x46l6" event={"ID":"396a5d6a-de36-4495-a3e7-1daaebcd8b06","Type":"ContainerDied","Data":"44adfda0edd7af4a1cba52ddf8b1f709a9c508e70b265a5f598386e570129735"} Jul 28 17:27:15.702245 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.701918 2559 scope.go:117] "RemoveContainer" containerID="0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8" Jul 28 17:27:15.714730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.710441 2559 scope.go:117] "RemoveContainer" containerID="0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8" Jul 28 17:27:15.714730 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:15.710712 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8\": container with ID starting with 0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8 not found: ID does not exist" containerID="0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8" Jul 28 17:27:15.714730 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.710748 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8"} err="failed to get container status \"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8\": rpc error: code = NotFound desc = could not find container \"0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8\": container with ID starting with 0a712ee19cf025edb92ff0557673c8a5b1d41d37006217e3881d4835df9083e8 not found: ID does not exist" Jul 28 17:27:15.720070 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.720037 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:27:15.723074 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:15.723050 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc8ffdb6d-x46l6"] Jul 28 17:27:17.568175 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:17.568128 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" path="/var/lib/kubelet/pods/396a5d6a-de36-4495-a3e7-1daaebcd8b06/volumes" Jul 28 17:27:29.004437 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.004406 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf"] Jul 28 17:27:29.004811 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.004670 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" containerName="console" Jul 28 17:27:29.004811 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.004680 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" containerName="console" Jul 28 17:27:29.004811 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.004740 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="396a5d6a-de36-4495-a3e7-1daaebcd8b06" containerName="console" Jul 28 17:27:29.007649 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.007631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.010543 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.010517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qvr76\"" Jul 28 17:27:29.010701 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.010682 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 17:27:29.011292 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.011276 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 17:27:29.022312 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.022286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf"] Jul 28 17:27:29.082779 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.082744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.082970 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.082795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tzg\" (UniqueName: \"kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.082970 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.082880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.184094 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.184050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.184277 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.184107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tzg\" (UniqueName: \"kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.184277 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.184146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.184489 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.184466 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.184558 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.184514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.193222 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.193199 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tzg\" (UniqueName: \"kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.316557 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.316461 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:29.443852 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.443819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf"] Jul 28 17:27:29.446724 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:27:29.446703 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2152037a_4b0c_41af_a8d0_5dd4f6f5aa6e.slice/crio-b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a WatchSource:0}: Error finding container b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a: Status 404 returned error can't find the container with id b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a Jul 28 17:27:29.755583 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:29.755552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" event={"ID":"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e","Type":"ContainerStarted","Data":"b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a"} Jul 28 17:27:35.782521 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:35.782491 2559 generic.go:356] "Generic (PLEG): container finished" podID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerID="ef2e8c48380a4000c31cc2e065f31eed2d2743267112776de8c61b595004cc76" exitCode=0 Jul 28 17:27:35.782941 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:35.782585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" event={"ID":"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e","Type":"ContainerDied","Data":"ef2e8c48380a4000c31cc2e065f31eed2d2743267112776de8c61b595004cc76"} Jul 28 17:27:37.792314 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:37.792276 2559 generic.go:356] "Generic (PLEG): container finished" podID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerID="a96d9f228db0f743801288e9a79fc2d76a588864f051313902e2e77a40c8a0f8" exitCode=0 Jul 28 17:27:37.792698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:37.792328 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" event={"ID":"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e","Type":"ContainerDied","Data":"a96d9f228db0f743801288e9a79fc2d76a588864f051313902e2e77a40c8a0f8"} Jul 28 17:27:44.824570 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:44.824540 2559 generic.go:356] "Generic (PLEG): container finished" podID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerID="65835bc427691a1118fba3678ef7c802db497991fd9a296cb03fe45d115af963" exitCode=0 Jul 28 17:27:44.824948 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:44.824599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" event={"ID":"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e","Type":"ContainerDied","Data":"65835bc427691a1118fba3678ef7c802db497991fd9a296cb03fe45d115af963"} Jul 28 17:27:45.956330 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:45.956299 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:46.132995 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.132899 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle\") pod \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " Jul 28 17:27:46.132995 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.132947 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5tzg\" (UniqueName: \"kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg\") pod \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " Jul 28 17:27:46.132995 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.132975 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util\") pod \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\" (UID: \"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e\") " Jul 28 17:27:46.133661 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.133626 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle" (OuterVolumeSpecName: "bundle") pod "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" (UID: "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:27:46.135351 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.135320 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg" (OuterVolumeSpecName: "kube-api-access-t5tzg") pod "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" (UID: "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e"). InnerVolumeSpecName "kube-api-access-t5tzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:27:46.137353 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.137330 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util" (OuterVolumeSpecName: "util") pod "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" (UID: "2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:27:46.233926 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.233869 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:46.233926 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.233916 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5tzg\" (UniqueName: \"kubernetes.io/projected/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-kube-api-access-t5tzg\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:46.233926 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.233926 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e-util\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:27:46.834426 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.834396 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" Jul 28 17:27:46.834611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.834397 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qmflf" event={"ID":"2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e","Type":"ContainerDied","Data":"b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a"} Jul 28 17:27:46.834611 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:46.834528 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5eee93d9fb27738efde777132c21a129e8d28002b2acd70f7314dcb8992613a" Jul 28 17:27:52.324114 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324062 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz"] Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324505 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="util" Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324523 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="util" Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324546 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="extract" Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324556 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="extract" Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324574 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="pull" Jul 28 17:27:52.324632 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324581 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="pull" Jul 28 17:27:52.324965 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.324649 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2152037a-4b0c-41af-a8d0-5dd4f6f5aa6e" containerName="extract" Jul 28 17:27:52.329091 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.329067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.333054 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.333027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 17:27:52.333236 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.333220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-n4dwc\"" Jul 28 17:27:52.333570 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.333550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 17:27:52.333693 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.333679 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 17:27:52.350686 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.350652 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz"] Jul 28 17:27:52.487555 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.487510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ec2d7880-de99-4c23-a198-b48483492cab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.487555 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.487556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kw7b\" (UniqueName: \"kubernetes.io/projected/ec2d7880-de99-4c23-a198-b48483492cab-kube-api-access-7kw7b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.588950 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.588855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ec2d7880-de99-4c23-a198-b48483492cab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.588950 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.588904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kw7b\" (UniqueName: \"kubernetes.io/projected/ec2d7880-de99-4c23-a198-b48483492cab-kube-api-access-7kw7b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.591486 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.591467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ec2d7880-de99-4c23-a198-b48483492cab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.603608 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.603581 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kw7b\" (UniqueName: \"kubernetes.io/projected/ec2d7880-de99-4c23-a198-b48483492cab-kube-api-access-7kw7b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz\" (UID: \"ec2d7880-de99-4c23-a198-b48483492cab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.639565 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.639517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:52.806681 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.806654 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz"] Jul 28 17:27:52.808537 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:27:52.808509 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2d7880_de99_4c23_a198_b48483492cab.slice/crio-80c8568ae5a038d7e1b1dd4cafff0458c2a308207b8609f4ca10c4df50262d06 WatchSource:0}: Error finding container 80c8568ae5a038d7e1b1dd4cafff0458c2a308207b8609f4ca10c4df50262d06: Status 404 returned error can't find the container with id 80c8568ae5a038d7e1b1dd4cafff0458c2a308207b8609f4ca10c4df50262d06 Jul 28 17:27:52.857066 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:52.856975 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" event={"ID":"ec2d7880-de99-4c23-a198-b48483492cab","Type":"ContainerStarted","Data":"80c8568ae5a038d7e1b1dd4cafff0458c2a308207b8609f4ca10c4df50262d06"} Jul 28 17:27:53.397890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:53.397866 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 17:27:56.833055 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.833022 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-kzfcc"] Jul 28 17:27:56.835353 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.835338 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:56.838308 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.838286 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 28 17:27:56.838456 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.838342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 17:27:56.838456 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.838434 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-pv7jg\"" Jul 28 17:27:56.848469 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.847992 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-kzfcc"] Jul 28 17:27:56.876386 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.876351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" event={"ID":"ec2d7880-de99-4c23-a198-b48483492cab","Type":"ContainerStarted","Data":"a2b3e006c44e70cf5dd41f750f7a9dccb50bd4128be3308eadcf2346ccadab69"} Jul 28 17:27:56.876587 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.876516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:27:56.897454 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.897394 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" podStartSLOduration=1.711664055 podStartE2EDuration="4.897376817s" totalImagesPullingTime="3.185712762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:27:56.897068692 +0000 UTC m=+303.966312569" watchObservedRunningTime="2026-07-28 17:27:56.897376817 +0000 UTC m=+303.966620673" Jul 28 17:27:56.919847 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.919810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:56.920028 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.919870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5z6h\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-kube-api-access-r5z6h\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:56.920028 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:56.919905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e617ac2-791b-4252-8376-092768fedd21-cabundle0\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.020743 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.020701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5z6h\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-kube-api-access-r5z6h\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.020930 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.020752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e617ac2-791b-4252-8376-092768fedd21-cabundle0\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.020930 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.020809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.020930 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.020909 2559 secret.go:281] references non-existent secret key: ca.crt Jul 28 17:27:57.020930 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.020923 2559 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 17:27:57.020930 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.020933 2559 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-kzfcc: references non-existent secret key: ca.crt Jul 28 17:27:57.021231 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.020992 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates podName:8e617ac2-791b-4252-8376-092768fedd21 nodeName:}" failed. No retries permitted until 2026-07-28 17:27:57.520973995 +0000 UTC m=+304.590217854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates") pod "keda-operator-77f648d694-kzfcc" (UID: "8e617ac2-791b-4252-8376-092768fedd21") : references non-existent secret key: ca.crt Jul 28 17:27:57.021568 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.021542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e617ac2-791b-4252-8376-092768fedd21-cabundle0\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.032331 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.032297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5z6h\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-kube-api-access-r5z6h\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.524171 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.524134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:57.524353 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.524290 2559 secret.go:281] references non-existent secret key: ca.crt Jul 28 17:27:57.524353 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.524310 2559 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 17:27:57.524353 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.524319 2559 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-kzfcc: references non-existent secret key: ca.crt Jul 28 17:27:57.524473 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:27:57.524381 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates podName:8e617ac2-791b-4252-8376-092768fedd21 nodeName:}" failed. No retries permitted until 2026-07-28 17:27:58.524364896 +0000 UTC m=+305.593608752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates") pod "keda-operator-77f648d694-kzfcc" (UID: "8e617ac2-791b-4252-8376-092768fedd21") : references non-existent secret key: ca.crt Jul 28 17:27:57.688579 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.688543 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-897zx"] Jul 28 17:27:57.691011 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.690987 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.694702 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.694679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 17:27:57.707339 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.707310 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-897zx"] Jul 28 17:27:57.725655 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.725627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwr6\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-kube-api-access-wkwr6\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.725826 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.725667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c0e8cddf-ab55-4f44-941a-56ef15cbe191-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.725826 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.725703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-certificates\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.826366 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.826277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-certificates\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.826529 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.826378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwr6\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-kube-api-access-wkwr6\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.826529 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.826401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c0e8cddf-ab55-4f44-941a-56ef15cbe191-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.826734 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.826716 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/c0e8cddf-ab55-4f44-941a-56ef15cbe191-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.829262 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.829222 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-certificates\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.841692 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.841660 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwr6\" (UniqueName: \"kubernetes.io/projected/c0e8cddf-ab55-4f44-941a-56ef15cbe191-kube-api-access-wkwr6\") pod \"keda-metrics-apiserver-55557df8c-897zx\" (UID: \"c0e8cddf-ab55-4f44-941a-56ef15cbe191\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:57.888367 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.888333 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f4tzl"] Jul 28 17:27:57.890861 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.890836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:57.893439 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.893381 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 17:27:57.902604 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.902573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f4tzl"] Jul 28 17:27:57.927317 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.927278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqqs\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-kube-api-access-7mqqs\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:57.927506 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:57.927433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-certificates\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.001823 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.001548 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:27:58.028255 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.028220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-certificates\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.028409 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.028310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqqs\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-kube-api-access-7mqqs\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.031139 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.031110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-certificates\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.037149 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.037122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqqs\" (UniqueName: \"kubernetes.io/projected/bfd1c67a-194e-46af-8a39-c3898c0c52f3-kube-api-access-7mqqs\") pod \"keda-admission-56f9798bb4-f4tzl\" (UID: \"bfd1c67a-194e-46af-8a39-c3898c0c52f3\") " pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.175264 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.175218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-897zx"] Jul 28 17:27:58.178518 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:27:58.178486 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e8cddf_ab55_4f44_941a_56ef15cbe191.slice/crio-f77f2c473d18aa1ec2bab2204fe287d0aadf6905a60b362fdb2d006da3147e79 WatchSource:0}: Error finding container f77f2c473d18aa1ec2bab2204fe287d0aadf6905a60b362fdb2d006da3147e79: Status 404 returned error can't find the container with id f77f2c473d18aa1ec2bab2204fe287d0aadf6905a60b362fdb2d006da3147e79 Jul 28 17:27:58.181858 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.181838 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:27:58.202763 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.202728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:27:58.350338 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.350148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f4tzl"] Jul 28 17:27:58.353950 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:27:58.353925 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd1c67a_194e_46af_8a39_c3898c0c52f3.slice/crio-495fda98f15f88f62e7ba6675fca12f805800f0873a35439ff7077146cc72972 WatchSource:0}: Error finding container 495fda98f15f88f62e7ba6675fca12f805800f0873a35439ff7077146cc72972: Status 404 returned error can't find the container with id 495fda98f15f88f62e7ba6675fca12f805800f0873a35439ff7077146cc72972 Jul 28 17:27:58.533781 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.533747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:58.536274 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.536256 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e617ac2-791b-4252-8376-092768fedd21-certificates\") pod \"keda-operator-77f648d694-kzfcc\" (UID: \"8e617ac2-791b-4252-8376-092768fedd21\") " pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:58.645349 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.645270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:27:58.775889 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.775861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-kzfcc"] Jul 28 17:27:58.777907 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:27:58.777878 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e617ac2_791b_4252_8376_092768fedd21.slice/crio-85a9ee6f023d156fc36a29d703194a0aa1647d9e06b00b7e9728eac1e56105a4 WatchSource:0}: Error finding container 85a9ee6f023d156fc36a29d703194a0aa1647d9e06b00b7e9728eac1e56105a4: Status 404 returned error can't find the container with id 85a9ee6f023d156fc36a29d703194a0aa1647d9e06b00b7e9728eac1e56105a4 Jul 28 17:27:58.885928 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.885895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" event={"ID":"bfd1c67a-194e-46af-8a39-c3898c0c52f3","Type":"ContainerStarted","Data":"495fda98f15f88f62e7ba6675fca12f805800f0873a35439ff7077146cc72972"} Jul 28 17:27:58.886977 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.886952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" event={"ID":"c0e8cddf-ab55-4f44-941a-56ef15cbe191","Type":"ContainerStarted","Data":"f77f2c473d18aa1ec2bab2204fe287d0aadf6905a60b362fdb2d006da3147e79"} Jul 28 17:27:58.887977 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:27:58.887947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-kzfcc" event={"ID":"8e617ac2-791b-4252-8376-092768fedd21","Type":"ContainerStarted","Data":"85a9ee6f023d156fc36a29d703194a0aa1647d9e06b00b7e9728eac1e56105a4"} Jul 28 17:28:02.908819 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.908712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" event={"ID":"bfd1c67a-194e-46af-8a39-c3898c0c52f3","Type":"ContainerStarted","Data":"4f51f0adab8e72f27f837d481d739cd95f3b0ae2b4dda83abb0af813911f3575"} Jul 28 17:28:02.909294 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.908830 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:28:02.910255 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.910229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" event={"ID":"c0e8cddf-ab55-4f44-941a-56ef15cbe191","Type":"ContainerStarted","Data":"8ff63ce98629b7a054625e8cf1f871d69096dbe0fc7b3fd5ac92246553fc9ec9"} Jul 28 17:28:02.910389 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.910325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:28:02.911666 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.911638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-kzfcc" event={"ID":"8e617ac2-791b-4252-8376-092768fedd21","Type":"ContainerStarted","Data":"aa5415d563c8c5929c09ab2eeddca9582539dc37da20433b5493d94702e16aaf"} Jul 28 17:28:02.911793 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.911781 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:28:02.929259 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.929207 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" podStartSLOduration=1.714874011 podStartE2EDuration="5.929190441s" totalImagesPullingTime="4.21431643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:28:02.928259488 +0000 UTC m=+309.997503389" watchObservedRunningTime="2026-07-28 17:28:02.929190441 +0000 UTC m=+309.998434322" Jul 28 17:28:02.946182 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.946122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-kzfcc" podStartSLOduration=3.144969934 podStartE2EDuration="6.946106744s" totalImagesPullingTime="3.80113681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:28:02.946072715 +0000 UTC m=+310.015316594" watchObservedRunningTime="2026-07-28 17:28:02.946106744 +0000 UTC m=+310.015350624" Jul 28 17:28:02.965554 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:02.965515 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" podStartSLOduration=1.5681986650000002 podStartE2EDuration="5.965504099s" totalImagesPullingTime="4.397305434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:28:02.964224901 +0000 UTC m=+310.033468778" watchObservedRunningTime="2026-07-28 17:28:02.965504099 +0000 UTC m=+310.034747976" Jul 28 17:28:13.931049 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:13.931017 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-897zx" Jul 28 17:28:17.883266 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:17.883225 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g8mnz" Jul 28 17:28:23.929065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:23.929036 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-kzfcc" Jul 28 17:28:23.929564 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:28:23.929115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-f4tzl" Jul 28 17:29:17.064606 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.064567 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:29:17.067378 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.067357 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-5jgm8"] Jul 28 17:29:17.067510 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.067472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.069833 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.069814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.070379 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.070360 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-qp6m7\"" Jul 28 17:29:17.070480 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.070393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 17:29:17.071643 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.071611 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 17:29:17.071643 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.071623 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 17:29:17.072452 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.072436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-7jbv4\"" Jul 28 17:29:17.072554 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.072536 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 28 17:29:17.085416 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.085386 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:29:17.090924 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.090900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-5jgm8"] Jul 28 17:29:17.120817 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.120795 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-8c85j"] Jul 28 17:29:17.123246 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.123228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.128340 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.128304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-wfhr9\"" Jul 28 17:29:17.128668 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.128653 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 17:29:17.134387 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.134365 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-8c85j"] Jul 28 17:29:17.170286 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.170419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dnjx\" (UniqueName: \"kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.170419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm874\" (UniqueName: \"kubernetes.io/projected/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-kube-api-access-xm874\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.170419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-data\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.170569 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.170569 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.170488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9wf\" (UniqueName: \"kubernetes.io/projected/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-kube-api-access-xz9wf\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.271477 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dnjx\" (UniqueName: \"kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm874\" (UniqueName: \"kubernetes.io/projected/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-kube-api-access-xm874\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-data\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.271596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9wf\" (UniqueName: \"kubernetes.io/projected/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-kube-api-access-xz9wf\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.271621 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:29:17.271603 2559 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 28 17:29:17.271876 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:29:17.271683 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert podName:d5140dfc-3453-4b8d-bda4-81efc47b1b0b nodeName:}" failed. No retries permitted until 2026-07-28 17:29:17.771662494 +0000 UTC m=+384.840906350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert") pod "llmisvc-controller-manager-654c557856-5jgm8" (UID: "d5140dfc-3453-4b8d-bda4-81efc47b1b0b") : secret "llmisvc-webhook-server-cert" not found Jul 28 17:29:17.272052 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.272035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-data\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.274189 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.274150 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.283988 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.283961 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm874\" (UniqueName: \"kubernetes.io/projected/2f487d57-a8b7-4ea1-9dd5-a59075942ce9-kube-api-access-xm874\") pod \"seaweedfs-64568bcd49-8c85j\" (UID: \"2f487d57-a8b7-4ea1-9dd5-a59075942ce9\") " pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.284285 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.284268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9wf\" (UniqueName: \"kubernetes.io/projected/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-kube-api-access-xz9wf\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.289203 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.289182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dnjx\" (UniqueName: \"kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx\") pod \"kserve-controller-manager-cd4d44c67-4ntr5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.378631 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.378554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:17.431994 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.431960 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:17.522234 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.522181 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:29:17.525780 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:29:17.525746 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa92aeb_f626_4e71_8c3f_06f197e27fc5.slice/crio-7e252e1d84cbdb6f56e326bf1c73982487496cf1edd5b84b8a3c2c294ad68023 WatchSource:0}: Error finding container 7e252e1d84cbdb6f56e326bf1c73982487496cf1edd5b84b8a3c2c294ad68023: Status 404 returned error can't find the container with id 7e252e1d84cbdb6f56e326bf1c73982487496cf1edd5b84b8a3c2c294ad68023 Jul 28 17:29:17.574419 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.574318 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-8c85j"] Jul 28 17:29:17.576466 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:29:17.576444 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f487d57_a8b7_4ea1_9dd5_a59075942ce9.slice/crio-c09ef86fe88166fbf072fa1955aef9864e2e12ccfd6c69f019741495235d321f WatchSource:0}: Error finding container c09ef86fe88166fbf072fa1955aef9864e2e12ccfd6c69f019741495235d321f: Status 404 returned error can't find the container with id c09ef86fe88166fbf072fa1955aef9864e2e12ccfd6c69f019741495235d321f Jul 28 17:29:17.775426 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.775387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.777896 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.777873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5140dfc-3453-4b8d-bda4-81efc47b1b0b-cert\") pod \"llmisvc-controller-manager-654c557856-5jgm8\" (UID: \"d5140dfc-3453-4b8d-bda4-81efc47b1b0b\") " pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:17.985354 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:17.985312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:18.172435 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:18.171730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-5jgm8"] Jul 28 17:29:18.197099 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:29:18.197062 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd5140dfc_3453_4b8d_bda4_81efc47b1b0b.slice/crio-a4c82de97dd25079e3f3d432a6a5e928e4ff46955fa8d5efa4a8d63f4bcfd1b4 WatchSource:0}: Error finding container a4c82de97dd25079e3f3d432a6a5e928e4ff46955fa8d5efa4a8d63f4bcfd1b4: Status 404 returned error can't find the container with id a4c82de97dd25079e3f3d432a6a5e928e4ff46955fa8d5efa4a8d63f4bcfd1b4 Jul 28 17:29:18.254072 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:18.254027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" event={"ID":"0aa92aeb-f626-4e71-8c3f-06f197e27fc5","Type":"ContainerStarted","Data":"7e252e1d84cbdb6f56e326bf1c73982487496cf1edd5b84b8a3c2c294ad68023"} Jul 28 17:29:18.255795 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:18.255760 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-8c85j" event={"ID":"2f487d57-a8b7-4ea1-9dd5-a59075942ce9","Type":"ContainerStarted","Data":"c09ef86fe88166fbf072fa1955aef9864e2e12ccfd6c69f019741495235d321f"} Jul 28 17:29:18.258368 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:18.258338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" event={"ID":"d5140dfc-3453-4b8d-bda4-81efc47b1b0b","Type":"ContainerStarted","Data":"a4c82de97dd25079e3f3d432a6a5e928e4ff46955fa8d5efa4a8d63f4bcfd1b4"} Jul 28 17:29:22.281516 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.281475 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" event={"ID":"0aa92aeb-f626-4e71-8c3f-06f197e27fc5","Type":"ContainerStarted","Data":"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97"} Jul 28 17:29:22.281936 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.281548 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:22.283376 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.283351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-8c85j" event={"ID":"2f487d57-a8b7-4ea1-9dd5-a59075942ce9","Type":"ContainerStarted","Data":"4927a2edc89d10301de8aac1327e89fb8f97a20e266c8ab7ba60e14820e613db"} Jul 28 17:29:22.283512 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.283411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:22.300289 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.300221 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" podStartSLOduration=1.571188816 podStartE2EDuration="5.300199355s" totalImagesPullingTime="3.729010539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:29:22.299669374 +0000 UTC m=+389.368913254" watchObservedRunningTime="2026-07-28 17:29:22.300199355 +0000 UTC m=+389.369443235" Jul 28 17:29:22.320062 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:22.320011 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-8c85j" podStartSLOduration=1.108479357 podStartE2EDuration="5.319994656s" totalImagesPullingTime="4.211515299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:29:22.318847152 +0000 UTC m=+389.388091031" watchObservedRunningTime="2026-07-28 17:29:22.319994656 +0000 UTC m=+389.389238571" Jul 28 17:29:23.289002 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:23.288958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" event={"ID":"d5140dfc-3453-4b8d-bda4-81efc47b1b0b","Type":"ContainerStarted","Data":"f9e66b759e2d28bf869173526d354e7034f71d5da62ae3bb7a6c9f6796db71bd"} Jul 28 17:29:23.289488 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:23.289325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:29:23.307131 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:23.307079 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" podStartSLOduration=1.623867425 podStartE2EDuration="6.307063349s" totalImagesPullingTime="4.683195924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:29:23.306482376 +0000 UTC m=+390.375726254" watchObservedRunningTime="2026-07-28 17:29:23.307063349 +0000 UTC m=+390.376307226" Jul 28 17:29:28.291257 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:28.291220 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-8c85j" Jul 28 17:29:53.294462 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:53.294430 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:29:54.295983 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:29:54.295950 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-5jgm8" Jul 28 17:30:02.128687 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.128648 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:30:02.129127 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.128861 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" podUID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" containerName="manager" containerID="cri-o://8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97" gracePeriod=10 Jul 28 17:30:02.151571 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.151537 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-mrnkn"] Jul 28 17:30:02.158670 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.158640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.162506 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.162480 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-mrnkn"] Jul 28 17:30:02.265938 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.265895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a595d9-8ca1-4304-b707-7b9438811cfc-cert\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.265938 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.265937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbjbt\" (UniqueName: \"kubernetes.io/projected/54a595d9-8ca1-4304-b707-7b9438811cfc-kube-api-access-fbjbt\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.366507 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.366468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a595d9-8ca1-4304-b707-7b9438811cfc-cert\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.366640 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.366518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbjbt\" (UniqueName: \"kubernetes.io/projected/54a595d9-8ca1-4304-b707-7b9438811cfc-kube-api-access-fbjbt\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.369269 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.369134 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a595d9-8ca1-4304-b707-7b9438811cfc-cert\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.375037 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.375007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbjbt\" (UniqueName: \"kubernetes.io/projected/54a595d9-8ca1-4304-b707-7b9438811cfc-kube-api-access-fbjbt\") pod \"kserve-controller-manager-cd4d44c67-mrnkn\" (UID: \"54a595d9-8ca1-4304-b707-7b9438811cfc\") " pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.391472 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.391401 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:30:02.456066 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.456030 2559 generic.go:356] "Generic (PLEG): container finished" podID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" containerID="8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97" exitCode=0 Jul 28 17:30:02.456278 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.456088 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" Jul 28 17:30:02.456278 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.456119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" event={"ID":"0aa92aeb-f626-4e71-8c3f-06f197e27fc5","Type":"ContainerDied","Data":"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97"} Jul 28 17:30:02.456278 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.456193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-4ntr5" event={"ID":"0aa92aeb-f626-4e71-8c3f-06f197e27fc5","Type":"ContainerDied","Data":"7e252e1d84cbdb6f56e326bf1c73982487496cf1edd5b84b8a3c2c294ad68023"} Jul 28 17:30:02.456278 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.456219 2559 scope.go:117] "RemoveContainer" containerID="8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97" Jul 28 17:30:02.464941 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.464921 2559 scope.go:117] "RemoveContainer" containerID="8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97" Jul 28 17:30:02.465278 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:30:02.465253 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97\": container with ID starting with 8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97 not found: ID does not exist" containerID="8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97" Jul 28 17:30:02.465337 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.465295 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97"} err="failed to get container status \"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97\": rpc error: code = NotFound desc = could not find container \"8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97\": container with ID starting with 8acae1a110ba6be0f0cdf679a2e4cf2ba5a303a7a12b817d260c05c332e36f97 not found: ID does not exist" Jul 28 17:30:02.467558 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.467540 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dnjx\" (UniqueName: \"kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx\") pod \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " Jul 28 17:30:02.467650 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.467639 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert\") pod \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\" (UID: \"0aa92aeb-f626-4e71-8c3f-06f197e27fc5\") " Jul 28 17:30:02.469767 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.469743 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx" (OuterVolumeSpecName: "kube-api-access-6dnjx") pod "0aa92aeb-f626-4e71-8c3f-06f197e27fc5" (UID: "0aa92aeb-f626-4e71-8c3f-06f197e27fc5"). InnerVolumeSpecName "kube-api-access-6dnjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:30:02.469767 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.469743 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert" (OuterVolumeSpecName: "cert") pod "0aa92aeb-f626-4e71-8c3f-06f197e27fc5" (UID: "0aa92aeb-f626-4e71-8c3f-06f197e27fc5"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:30:02.516608 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.516570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:02.569342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.569312 2559 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:30:02.569448 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.569347 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dnjx\" (UniqueName: \"kubernetes.io/projected/0aa92aeb-f626-4e71-8c3f-06f197e27fc5-kube-api-access-6dnjx\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:30:02.655719 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.655694 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-mrnkn"] Jul 28 17:30:02.658183 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:30:02.658138 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a595d9_8ca1_4304_b707_7b9438811cfc.slice/crio-24f84d4a64ae6a07dcfc0de918f01390ec305e7b030813ddb52babbf7e72dbd0 WatchSource:0}: Error finding container 24f84d4a64ae6a07dcfc0de918f01390ec305e7b030813ddb52babbf7e72dbd0: Status 404 returned error can't find the container with id 24f84d4a64ae6a07dcfc0de918f01390ec305e7b030813ddb52babbf7e72dbd0 Jul 28 17:30:02.777904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.777876 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:30:02.781264 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:02.781238 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-4ntr5"] Jul 28 17:30:03.462464 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:03.462354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" event={"ID":"54a595d9-8ca1-4304-b707-7b9438811cfc","Type":"ContainerStarted","Data":"a804c877f1f36dbccfbbdd41011b9bddaccc270ce400ecc0b6e08b681194cae2"} Jul 28 17:30:03.462464 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:03.462420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" event={"ID":"54a595d9-8ca1-4304-b707-7b9438811cfc","Type":"ContainerStarted","Data":"24f84d4a64ae6a07dcfc0de918f01390ec305e7b030813ddb52babbf7e72dbd0"} Jul 28 17:30:03.462982 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:03.462515 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:03.479736 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:03.479680 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" podStartSLOduration=1.040416346 podStartE2EDuration="1.479663207s" totalImagesPullingTime="439.246861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:30:03.478975548 +0000 UTC m=+430.548219426" watchObservedRunningTime="2026-07-28 17:30:03.479663207 +0000 UTC m=+430.548907085" Jul 28 17:30:03.569740 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:03.569708 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" path="/var/lib/kubelet/pods/0aa92aeb-f626-4e71-8c3f-06f197e27fc5/volumes" Jul 28 17:30:34.474085 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:34.474008 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-mrnkn" Jul 28 17:30:35.580145 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.580104 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2744w"] Jul 28 17:30:35.580547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.580451 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" containerName="manager" Jul 28 17:30:35.580547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.580462 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" containerName="manager" Jul 28 17:30:35.580547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.580525 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa92aeb-f626-4e71-8c3f-06f197e27fc5" containerName="manager" Jul 28 17:30:35.582780 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.582760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.585053 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.585027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 28 17:30:35.585210 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.585075 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-kxswj\"" Jul 28 17:30:35.592272 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.592250 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2744w"] Jul 28 17:30:35.758542 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.758503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqv7w\" (UniqueName: \"kubernetes.io/projected/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-kube-api-access-vqv7w\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.758542 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.758540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-cert\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.859198 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.859082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqv7w\" (UniqueName: \"kubernetes.io/projected/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-kube-api-access-vqv7w\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.859198 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.859139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-cert\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.861672 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.861641 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-cert\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.867435 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.867409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqv7w\" (UniqueName: \"kubernetes.io/projected/887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2-kube-api-access-vqv7w\") pod \"odh-model-controller-75d9cdbddf-2744w\" (UID: \"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2\") " pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:35.894066 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:35.894036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:36.031564 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:36.031541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2744w"] Jul 28 17:30:36.034255 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:30:36.034210 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887c9ed1_59cd_4ff5_9b19_a3cb1b8ee2a2.slice/crio-c90918961f5eb7c30b1c5f798ce7f2ba2b87c1451c5f10fffc54fec332e83d9a WatchSource:0}: Error finding container c90918961f5eb7c30b1c5f798ce7f2ba2b87c1451c5f10fffc54fec332e83d9a: Status 404 returned error can't find the container with id c90918961f5eb7c30b1c5f798ce7f2ba2b87c1451c5f10fffc54fec332e83d9a Jul 28 17:30:36.611253 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:36.611197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-2744w" event={"ID":"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2","Type":"ContainerStarted","Data":"c90918961f5eb7c30b1c5f798ce7f2ba2b87c1451c5f10fffc54fec332e83d9a"} Jul 28 17:30:38.623349 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:38.623318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-2744w" event={"ID":"887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2","Type":"ContainerStarted","Data":"5a2bcb673cb9a656ccef88e16b8bf7af7552ad0a20a308e01ea6804a76154c7c"} Jul 28 17:30:38.623718 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:38.623468 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:30:38.641409 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:38.641359 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-2744w" podStartSLOduration=1.133903823 podStartE2EDuration="3.64134269s" totalImagesPullingTime="2.507438867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:30:38.639658685 +0000 UTC m=+465.708902563" watchObservedRunningTime="2026-07-28 17:30:38.64134269 +0000 UTC m=+465.710586617" Jul 28 17:30:49.630904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:30:49.630875 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-2744w" Jul 28 17:35:38.450477 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.450439 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689ccd59d6-m6vm4"] Jul 28 17:35:38.452870 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.452853 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.479713 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.479677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689ccd59d6-m6vm4"] Jul 28 17:35:38.546547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546547 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-oauth-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-service-ca\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-trusted-ca-bundle\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-oauth-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.546772 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.546670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tsh\" (UniqueName: \"kubernetes.io/projected/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-kube-api-access-56tsh\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.647895 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.647859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.647895 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.647905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-oauth-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648119 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.647923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648119 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.647946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-service-ca\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648241 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-trusted-ca-bundle\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648241 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-oauth-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648241 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tsh\" (UniqueName: \"kubernetes.io/projected/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-kube-api-access-56tsh\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648768 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648886 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648861 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-oauth-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.648967 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.648949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-service-ca\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.649451 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.649427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-trusted-ca-bundle\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.650737 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.650720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-oauth-config\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.650790 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.650745 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-console-serving-cert\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.656502 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.656475 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tsh\" (UniqueName: \"kubernetes.io/projected/aa289a6e-d1dd-42dd-8afb-c5947bcc0a03-kube-api-access-56tsh\") pod \"console-689ccd59d6-m6vm4\" (UID: \"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03\") " pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.762330 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.762297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:38.901058 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.900903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689ccd59d6-m6vm4"] Jul 28 17:35:38.903951 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:35:38.903919 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa289a6e_d1dd_42dd_8afb_c5947bcc0a03.slice/crio-b3d8bbec5e5731b0db7980163f8bec92ddac1b6f46859b692264dea8a553d551 WatchSource:0}: Error finding container b3d8bbec5e5731b0db7980163f8bec92ddac1b6f46859b692264dea8a553d551: Status 404 returned error can't find the container with id b3d8bbec5e5731b0db7980163f8bec92ddac1b6f46859b692264dea8a553d551 Jul 28 17:35:38.951786 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:38.951763 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689ccd59d6-m6vm4" event={"ID":"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03","Type":"ContainerStarted","Data":"b3d8bbec5e5731b0db7980163f8bec92ddac1b6f46859b692264dea8a553d551"} Jul 28 17:35:39.958132 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:39.958090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689ccd59d6-m6vm4" event={"ID":"aa289a6e-d1dd-42dd-8afb-c5947bcc0a03","Type":"ContainerStarted","Data":"89391a6a56db1fb90cbcb83b1dfc24ca1d1197acd7267bf57d960bf150d8e35e"} Jul 28 17:35:39.976868 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:39.976803 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689ccd59d6-m6vm4" podStartSLOduration=1.9767850710000001 podStartE2EDuration="1.976785071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:39.975068555 +0000 UTC m=+767.044312461" watchObservedRunningTime="2026-07-28 17:35:39.976785071 +0000 UTC m=+767.046029026" Jul 28 17:35:48.762451 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:48.762397 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:48.762988 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:48.762477 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:48.767591 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:48.767566 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:49.002665 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:49.002637 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689ccd59d6-m6vm4" Jul 28 17:35:49.048648 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:35:49.048555 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:36:14.071033 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.070921 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8fb94955-tdmgq" podUID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" containerName="console" containerID="cri-o://bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064" gracePeriod=15 Jul 28 17:36:14.323613 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.323548 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:36:14.462942 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.462910 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463106 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.462962 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463106 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.462983 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9254f\" (UniqueName: \"kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463106 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463014 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463106 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463040 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463106 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463086 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463388 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463110 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert\") pod \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\" (UID: \"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6\") " Jul 28 17:36:14.463486 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463459 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:14.463549 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463517 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:14.463594 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463539 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:14.463594 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.463549 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config" (OuterVolumeSpecName: "console-config") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:14.465395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.465368 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:36:14.465395 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.465386 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:36:14.465539 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.465398 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f" (OuterVolumeSpecName: "kube-api-access-9254f") pod "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" (UID: "51d340c7-65c5-4f87-a5fa-d93aa8efe0a6"). InnerVolumeSpecName "kube-api-access-9254f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:36:14.564065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564029 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-oauth-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564056 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564065 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-service-ca\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564065 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564082 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-serving-cert\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564344 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564091 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-console-oauth-config\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564344 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564101 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-trusted-ca-bundle\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:14.564344 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:14.564109 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9254f\" (UniqueName: \"kubernetes.io/projected/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6-kube-api-access-9254f\") on node \"ip-10-0-141-94.ec2.internal\" DevicePath \"\"" Jul 28 17:36:15.122152 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.122110 2559 generic.go:356] "Generic (PLEG): container finished" podID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" containerID="bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064" exitCode=0 Jul 28 17:36:15.122578 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.122189 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8fb94955-tdmgq" Jul 28 17:36:15.122578 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.122194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fb94955-tdmgq" event={"ID":"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6","Type":"ContainerDied","Data":"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064"} Jul 28 17:36:15.122578 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.122259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8fb94955-tdmgq" event={"ID":"51d340c7-65c5-4f87-a5fa-d93aa8efe0a6","Type":"ContainerDied","Data":"ed2c1387020a467e7d9bd44492ac0832c3c8a97fd744a81e096827400affd121"} Jul 28 17:36:15.122578 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.122282 2559 scope.go:117] "RemoveContainer" containerID="bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064" Jul 28 17:36:15.131527 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.131509 2559 scope.go:117] "RemoveContainer" containerID="bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064" Jul 28 17:36:15.131806 ip-10-0-141-94 kubenswrapper[2559]: E0728 17:36:15.131787 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064\": container with ID starting with bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064 not found: ID does not exist" containerID="bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064" Jul 28 17:36:15.131872 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.131817 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064"} err="failed to get container status \"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064\": rpc error: code = NotFound desc = could not find container \"bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064\": container with ID starting with bf448e431469ca034a5199f83b21019189fbffadcf6fcb5cc83b951adfbc0064 not found: ID does not exist" Jul 28 17:36:15.143024 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.142984 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:36:15.144890 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.144869 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8fb94955-tdmgq"] Jul 28 17:36:15.569201 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:15.569147 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" path="/var/lib/kubelet/pods/51d340c7-65c5-4f87-a5fa-d93aa8efe0a6/volumes" Jul 28 17:36:17.293453 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.293415 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-np94q/must-gather-5n65k"] Jul 28 17:36:17.293835 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.293798 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" containerName="console" Jul 28 17:36:17.293835 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.293808 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" containerName="console" Jul 28 17:36:17.293904 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.293867 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d340c7-65c5-4f87-a5fa-d93aa8efe0a6" containerName="console" Jul 28 17:36:17.296799 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.296781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.299515 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.299490 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np94q\"/\"openshift-service-ca.crt\"" Jul 28 17:36:17.300365 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.300344 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np94q\"/\"kube-root-ca.crt\"" Jul 28 17:36:17.300472 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.300361 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-np94q\"/\"default-dockercfg-67784\"" Jul 28 17:36:17.307265 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.307243 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/must-gather-5n65k"] Jul 28 17:36:17.389970 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.389914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/763e3361-4907-4d52-a464-316c30fe82c5-must-gather-output\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.390201 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.389989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kn26\" (UniqueName: \"kubernetes.io/projected/763e3361-4907-4d52-a464-316c30fe82c5-kube-api-access-7kn26\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.490922 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.490871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/763e3361-4907-4d52-a464-316c30fe82c5-must-gather-output\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.491088 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.490934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn26\" (UniqueName: \"kubernetes.io/projected/763e3361-4907-4d52-a464-316c30fe82c5-kube-api-access-7kn26\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.491320 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.491296 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/763e3361-4907-4d52-a464-316c30fe82c5-must-gather-output\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.500545 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.500519 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kn26\" (UniqueName: \"kubernetes.io/projected/763e3361-4907-4d52-a464-316c30fe82c5-kube-api-access-7kn26\") pod \"must-gather-5n65k\" (UID: \"763e3361-4907-4d52-a464-316c30fe82c5\") " pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.622221 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.622099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/must-gather-5n65k" Jul 28 17:36:17.758382 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.758349 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/must-gather-5n65k"] Jul 28 17:36:17.761636 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:36:17.761607 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod763e3361_4907_4d52_a464_316c30fe82c5.slice/crio-64c29b3eaa0b2afe796826a20690c08a4ca0cf695e96bb0b86d4682b945b40d5 WatchSource:0}: Error finding container 64c29b3eaa0b2afe796826a20690c08a4ca0cf695e96bb0b86d4682b945b40d5: Status 404 returned error can't find the container with id 64c29b3eaa0b2afe796826a20690c08a4ca0cf695e96bb0b86d4682b945b40d5 Jul 28 17:36:17.763520 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:17.763506 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:36:18.137348 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:18.137305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/must-gather-5n65k" event={"ID":"763e3361-4907-4d52-a464-316c30fe82c5","Type":"ContainerStarted","Data":"64c29b3eaa0b2afe796826a20690c08a4ca0cf695e96bb0b86d4682b945b40d5"} Jul 28 17:36:19.152075 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:19.152036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/must-gather-5n65k" event={"ID":"763e3361-4907-4d52-a464-316c30fe82c5","Type":"ContainerStarted","Data":"60b3403e70834b6b39b7dc4f7bf6518ce89a43a2607303c1297c567cec306ccd"} Jul 28 17:36:19.152614 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:19.152087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/must-gather-5n65k" event={"ID":"763e3361-4907-4d52-a464-316c30fe82c5","Type":"ContainerStarted","Data":"7d2847a1cb496dc46bc1f4a22b895790afa9a5c7f13c4d6efc1d33db532c4f03"} Jul 28 17:36:19.170194 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:19.168542 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-np94q/must-gather-5n65k" podStartSLOduration=1.293875586 podStartE2EDuration="2.168520408s" totalImagesPullingTime="874.644822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:36:19.166756609 +0000 UTC m=+806.236000488" watchObservedRunningTime="2026-07-28 17:36:19.168520408 +0000 UTC m=+806.237764290" Jul 28 17:36:20.121265 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:20.121231 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nfsqz_e31bc2fe-a870-4f63-b199-51a9b3ac623c/global-pull-secret-syncer/0.log" Jul 28 17:36:20.260037 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:20.260001 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qbk5j_3f80c90d-5c72-42d9-841f-e32cf6d25659/konnectivity-agent/0.log" Jul 28 17:36:20.356770 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:20.356723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-94.ec2.internal_fc29e61c206e5b8484e1a2f844a63c6f/haproxy/0.log" Jul 28 17:36:24.749346 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.749308 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/alertmanager/0.log" Jul 28 17:36:24.784134 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.784102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/config-reloader/0.log" Jul 28 17:36:24.813762 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.813714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/kube-rbac-proxy-web/0.log" Jul 28 17:36:24.841219 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.841193 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/kube-rbac-proxy/0.log" Jul 28 17:36:24.871698 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.871645 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/kube-rbac-proxy-metric/0.log" Jul 28 17:36:24.901775 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.901750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/prom-label-proxy/0.log" Jul 28 17:36:24.935493 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:24.935464 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e82086f-1a25-4f09-b169-b98ef06fc0c7/init-config-reloader/0.log" Jul 28 17:36:25.169426 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.169339 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47qjl_7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70/node-exporter/0.log" Jul 28 17:36:25.190993 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.190959 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47qjl_7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70/kube-rbac-proxy/0.log" Jul 28 17:36:25.219639 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.219611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47qjl_7ecc0e0f-708f-4f9c-aa87-1eba4f4fdd70/init-textfile/0.log" Jul 28 17:36:25.700910 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.700874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6nfsz_3a0a7ab8-f19a-4cbf-a2a1-9074941f9973/prometheus-operator/0.log" Jul 28 17:36:25.722037 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.721995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6nfsz_3a0a7ab8-f19a-4cbf-a2a1-9074941f9973/kube-rbac-proxy/0.log" Jul 28 17:36:25.791226 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.791199 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8486f74bfd-8nw4m_f7ca54bf-9474-427a-a2b2-5678266ead37/telemeter-client/0.log" Jul 28 17:36:25.816110 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.816081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8486f74bfd-8nw4m_f7ca54bf-9474-427a-a2b2-5678266ead37/reload/0.log" Jul 28 17:36:25.839469 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.839443 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8486f74bfd-8nw4m_f7ca54bf-9474-427a-a2b2-5678266ead37/kube-rbac-proxy/0.log" Jul 28 17:36:25.877342 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.877315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/thanos-query/0.log" Jul 28 17:36:25.903674 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.903636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/kube-rbac-proxy-web/0.log" Jul 28 17:36:25.932020 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.931993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/kube-rbac-proxy/0.log" Jul 28 17:36:25.955418 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.955308 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/prom-label-proxy/0.log" Jul 28 17:36:25.977566 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:25.977536 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/kube-rbac-proxy-rules/0.log" Jul 28 17:36:26.001347 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:26.001316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bdd7f977c-sjgdp_f82e8340-05dd-4133-8e48-0ec7fe620769/kube-rbac-proxy-metrics/0.log" Jul 28 17:36:28.313765 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.313733 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-689ccd59d6-m6vm4_aa289a6e-d1dd-42dd-8afb-c5947bcc0a03/console/0.log" Jul 28 17:36:28.344541 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.344516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-x8lp5_f34fed2d-6573-41db-b59a-d5672e500099/download-server/0.log" Jul 28 17:36:28.812302 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.812248 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l"] Jul 28 17:36:28.817627 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.817604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.829338 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.827617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l"] Jul 28 17:36:28.895649 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.895616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5m2b\" (UniqueName: \"kubernetes.io/projected/eff3a818-a2bd-4e25-b307-d3c02eea30f5-kube-api-access-s5m2b\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.895843 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.895672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-podres\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.895843 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.895744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-proc\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.895843 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.895828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-lib-modules\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.895997 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.895891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-sys\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997174 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-lib-modules\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997467 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-lib-modules\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997654 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-sys\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997805 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5m2b\" (UniqueName: \"kubernetes.io/projected/eff3a818-a2bd-4e25-b307-d3c02eea30f5-kube-api-access-s5m2b\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997912 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-sys\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.997912 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-podres\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.998022 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997933 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-podres\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.998022 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.997950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-proc\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:28.998022 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:28.998011 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eff3a818-a2bd-4e25-b307-d3c02eea30f5-proc\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:29.006927 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:29.006899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5m2b\" (UniqueName: \"kubernetes.io/projected/eff3a818-a2bd-4e25-b307-d3c02eea30f5-kube-api-access-s5m2b\") pod \"perf-node-gather-daemonset-5jt4l\" (UID: \"eff3a818-a2bd-4e25-b307-d3c02eea30f5\") " pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:29.130407 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:29.130321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:29.309562 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:29.309523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l"] Jul 28 17:36:29.313183 ip-10-0-141-94 kubenswrapper[2559]: W0728 17:36:29.313112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeff3a818_a2bd_4e25_b307_d3c02eea30f5.slice/crio-e362a94a3162d4cefd1fee7523158949688fbe4039fd33be35a56b87702226d7 WatchSource:0}: Error finding container e362a94a3162d4cefd1fee7523158949688fbe4039fd33be35a56b87702226d7: Status 404 returned error can't find the container with id e362a94a3162d4cefd1fee7523158949688fbe4039fd33be35a56b87702226d7 Jul 28 17:36:29.927413 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:29.927383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmzwb_6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06/dns/0.log" Jul 28 17:36:29.974559 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:29.974532 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmzwb_6dc3ac6b-bb0b-4c02-8bbf-c6436510ae06/kube-rbac-proxy/0.log" Jul 28 17:36:30.071650 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.071622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jx5n_10e21d31-d702-42f4-9735-bd86abe4a890/dns-node-resolver/0.log" Jul 28 17:36:30.227911 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.227819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" event={"ID":"eff3a818-a2bd-4e25-b307-d3c02eea30f5","Type":"ContainerStarted","Data":"176b1f77dc55da4bbc001bfaf9e95a626256d1b644eee4d04caf425f179e5a2d"} Jul 28 17:36:30.228187 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.228144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" event={"ID":"eff3a818-a2bd-4e25-b307-d3c02eea30f5","Type":"ContainerStarted","Data":"e362a94a3162d4cefd1fee7523158949688fbe4039fd33be35a56b87702226d7"} Jul 28 17:36:30.228457 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.228432 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:30.244101 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.244029 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" podStartSLOduration=2.244010368 podStartE2EDuration="2.244010368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:36:30.243674902 +0000 UTC m=+817.312918780" watchObservedRunningTime="2026-07-28 17:36:30.244010368 +0000 UTC m=+817.313254247" Jul 28 17:36:30.599729 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:30.599702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fljvm_84893e60-7971-4b1b-bbb8-85bf205028d2/node-ca/0.log" Jul 28 17:36:31.749310 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:31.749248 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mgxtn_7da1954a-99fd-4005-87c3-e595474b533e/serve-healthcheck-canary/0.log" Jul 28 17:36:32.369643 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:32.369604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlv2r_a0bb0e18-7fbe-4861-96c9-42a06e9b69d5/kube-rbac-proxy/0.log" Jul 28 17:36:32.392837 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:32.392808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlv2r_a0bb0e18-7fbe-4861-96c9-42a06e9b69d5/exporter/0.log" Jul 28 17:36:32.416969 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:32.416939 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlv2r_a0bb0e18-7fbe-4861-96c9-42a06e9b69d5/extractor/0.log" Jul 28 17:36:34.648136 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:34.648100 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-cd4d44c67-mrnkn_54a595d9-8ca1-4304-b707-7b9438811cfc/manager/0.log" Jul 28 17:36:34.691831 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:34.691792 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-5jgm8_d5140dfc-3453-4b8d-bda4-81efc47b1b0b/manager/0.log" Jul 28 17:36:34.748616 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:34.748582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-2744w_887c9ed1-59cd-4ff5-9b19-a3cb1b8ee2a2/manager/0.log" Jul 28 17:36:34.853622 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:34.853593 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-8c85j_2f487d57-a8b7-4ea1-9dd5-a59075942ce9/seaweedfs/0.log" Jul 28 17:36:36.245963 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:36.245938 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-np94q/perf-node-gather-daemonset-5jt4l" Jul 28 17:36:40.529465 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:40.529428 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2xfxg_c51fb0fd-0ca9-4dd6-a8d0-aba6a5b62fcb/kube-multus/0.log" Jul 28 17:36:40.924635 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:40.924598 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/kube-multus-additional-cni-plugins/0.log" Jul 28 17:36:40.948631 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:40.948597 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/egress-router-binary-copy/0.log" Jul 28 17:36:40.972195 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:40.972146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/cni-plugins/0.log" Jul 28 17:36:40.994563 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:40.994533 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/bond-cni-plugin/0.log" Jul 28 17:36:41.016728 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:41.016701 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/routeoverride-cni/0.log" Jul 28 17:36:41.039326 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:41.039295 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/whereabouts-cni-bincopy/0.log" Jul 28 17:36:41.062133 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:41.062101 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtjd8_97ae91dc-4609-4ecb-beed-663318fd9640/whereabouts-cni/0.log" Jul 28 17:36:41.161483 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:41.161449 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kn29b_a3230072-6dbb-4b89-b502-154ffbb738f3/network-metrics-daemon/0.log" Jul 28 17:36:41.184221 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:41.184116 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kn29b_a3230072-6dbb-4b89-b502-154ffbb738f3/kube-rbac-proxy/0.log" Jul 28 17:36:42.448088 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.448056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/ovn-controller/0.log" Jul 28 17:36:42.466736 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.466705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/ovn-acl-logging/0.log" Jul 28 17:36:42.493588 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.493564 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/kube-rbac-proxy-node/0.log" Jul 28 17:36:42.517552 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.517522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 17:36:42.540358 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.540318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/northd/0.log" Jul 28 17:36:42.563789 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.563769 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/nbdb/0.log" Jul 28 17:36:42.589536 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.589512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/sbdb/0.log" Jul 28 17:36:42.651544 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:42.651510 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6kk_d74ffa94-7523-4210-b403-625929aedee2/ovnkube-controller/0.log" Jul 28 17:36:43.825049 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:43.825009 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5wlw5_ee056c84-e60a-4018-950e-7ec90602b554/network-check-target-container/0.log" Jul 28 17:36:45.034459 ip-10-0-141-94 kubenswrapper[2559]: I0728 17:36:45.034430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nmj4b_0d4b66c5-97c4-4415-ab98-be43ecac674a/iptables-alerter/0.log"