Jul 17 13:56:24.012293 ip-10-0-139-104 systemd[1]: Starting Kubernetes Kubelet... Jul 17 13:56:24.385467 ip-10-0-139-104 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:24.385467 ip-10-0-139-104 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 13:56:24.385467 ip-10-0-139-104 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:24.385467 ip-10-0-139-104 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 13:56:24.385467 ip-10-0-139-104 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:24.387204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.387116 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 13:56:24.391933 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.391895 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.392114 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392098 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.392194 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392187 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.392286 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392260 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.392286 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392283 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.392286 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392290 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392295 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392302 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392308 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392317 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392325 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392329 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392332 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392343 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.392435 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392364 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392489 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392494 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392497 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392500 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392502 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392505 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392508 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392511 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392514 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392516 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392519 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392521 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392524 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392526 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392529 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392532 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392534 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392537 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392540 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.392653 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392543 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392551 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392554 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392556 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392559 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392561 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392564 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392566 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392569 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392571 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392573 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392576 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392579 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392581 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392584 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392588 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392590 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392595 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392598 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392601 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.393148 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392604 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392607 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392610 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392613 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392615 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392618 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392621 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392623 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392626 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392629 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392631 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392634 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392636 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392639 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392641 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392643 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392646 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392648 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392651 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392653 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392656 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.393687 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392658 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392661 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392664 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392667 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392670 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392673 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392676 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392678 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392681 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392683 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392686 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392690 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392693 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392695 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392698 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392701 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392704 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392706 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392709 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392712 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.394225 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392714 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392717 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392720 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.392722 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393478 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393485 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393488 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393492 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393495 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393497 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393500 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393503 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393505 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393508 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393511 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393514 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393517 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393519 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393522 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393524 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.394697 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393527 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393530 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393533 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393535 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393538 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393541 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393543 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393547 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393551 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393554 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393557 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393559 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393562 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393564 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393568 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393571 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393574 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393576 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393579 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.395235 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393581 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393583 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393586 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393588 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393590 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393593 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393596 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393598 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393601 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393604 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393607 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393610 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393612 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393615 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393617 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393621 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393623 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393626 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393628 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393631 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.395723 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393633 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393635 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393638 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393640 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393643 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393645 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393648 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393650 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393653 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393655 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393658 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393660 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393662 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393665 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393668 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393670 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393672 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393674 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393677 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.396213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393680 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393684 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393688 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393693 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393696 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393698 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393701 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393704 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393707 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393710 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393713 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393715 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393718 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393721 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393723 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393726 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393728 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393730 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393733 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.396670 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393735 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393738 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393740 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393744 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393747 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.393750 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394178 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394184 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394187 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394190 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394192 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394195 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394198 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394200 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394204 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394207 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394209 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394212 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394214 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.397139 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394217 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394220 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394222 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394225 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394228 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394231 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394235 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394239 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394242 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394245 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394248 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394250 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394253 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394256 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394258 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394261 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394263 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394266 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394268 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.397595 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394271 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394276 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394279 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394282 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394285 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394288 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394290 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394293 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394295 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394297 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394301 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394303 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394306 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394308 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394311 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394313 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394315 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394318 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394321 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.398069 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394324 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394326 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394328 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394331 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394333 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394335 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394338 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394340 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394342 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394345 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394347 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394349 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394354 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394357 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394360 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394362 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394365 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394367 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394370 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394372 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.398545 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394375 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394377 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394397 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394403 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394406 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394409 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394412 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394415 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394417 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394420 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394422 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394425 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394428 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394430 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394432 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394435 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394437 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394440 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394442 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394445 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.399025 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394448 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394450 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394453 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394455 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394458 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394461 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394464 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.394466 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394536 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394543 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394550 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394564 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394568 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394572 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394576 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394580 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394583 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394586 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394589 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394592 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394596 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394599 2562 flags.go:64] FLAG: --cgroup-root="" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394601 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 13:56:24.399509 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394604 2562 flags.go:64] FLAG: --client-ca-file="" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394607 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394611 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394615 2562 flags.go:64] FLAG: --cluster-domain="" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394617 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394620 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394623 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394626 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394630 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394633 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394636 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394639 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394642 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394646 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394649 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394653 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394656 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394660 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394663 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394665 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394668 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394671 2562 flags.go:64] FLAG: --enable-server="true" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394674 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394678 2562 flags.go:64] FLAG: --event-burst="100" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394681 2562 flags.go:64] FLAG: --event-qps="50" Jul 17 13:56:24.400073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394684 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394687 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394689 2562 flags.go:64] FLAG: --eviction-hard="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394693 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394696 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394699 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394702 2562 flags.go:64] FLAG: --eviction-soft="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394704 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394707 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394711 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394714 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394717 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394720 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394722 2562 flags.go:64] FLAG: --feature-gates="" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394726 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394729 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394732 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394735 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394737 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394740 2562 flags.go:64] FLAG: --help="false" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394743 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394746 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394750 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 13:56:24.400669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394753 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394757 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394760 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394762 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394765 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394768 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394771 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394774 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394776 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394779 2562 flags.go:64] FLAG: --kube-reserved="" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394782 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394784 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394787 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394790 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394792 2562 flags.go:64] FLAG: --lock-file="" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394795 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394797 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394800 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394805 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394809 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394811 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394814 2562 flags.go:64] FLAG: --logging-format="text" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394816 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394820 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 13:56:24.401272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394822 2562 flags.go:64] FLAG: --manifest-url="" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394825 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394829 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394832 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394836 2562 flags.go:64] FLAG: --max-pods="110" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394839 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394842 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394846 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394849 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394852 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394854 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394857 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394866 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394869 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394872 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394875 2562 flags.go:64] FLAG: --pod-cidr="" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394878 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394883 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394885 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394888 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394891 2562 flags.go:64] FLAG: --port="10250" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394894 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394896 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-012f469df992274db" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394899 2562 flags.go:64] FLAG: --qos-reserved="" Jul 17 13:56:24.401845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394902 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394905 2562 flags.go:64] FLAG: --register-node="true" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394908 2562 flags.go:64] FLAG: --register-with-taints="" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394911 2562 flags.go:64] FLAG: --registry-burst="10" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394915 2562 flags.go:64] FLAG: --registry-qps="5" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394918 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394920 2562 flags.go:64] FLAG: --reserved-memory="" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394924 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394926 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394929 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394932 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394934 2562 flags.go:64] FLAG: --runonce="false" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394937 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394940 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394943 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394947 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394950 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394953 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394956 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394958 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394961 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394964 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394966 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394969 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394972 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 13:56:24.402462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394974 2562 flags.go:64] FLAG: --system-cgroups="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394977 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394982 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394984 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394987 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394990 2562 flags.go:64] FLAG: --tls-min-version="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394993 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394995 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.394998 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395001 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395003 2562 flags.go:64] FLAG: --v="2" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395007 2562 flags.go:64] FLAG: --version="false" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395011 2562 flags.go:64] FLAG: --vmodule="" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395014 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395017 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395148 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395153 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395156 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395159 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395162 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395165 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395169 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.403154 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395174 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395177 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395180 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395183 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395186 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395189 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395192 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395194 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395197 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395199 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395202 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395205 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395207 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395210 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395213 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395215 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395219 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395222 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395225 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395227 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.403682 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395230 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395232 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395235 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395238 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395240 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395243 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395246 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395248 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395251 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395255 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395257 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395260 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395265 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395268 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395270 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395273 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395276 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395279 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395281 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.404208 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395283 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395286 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395288 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395291 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395293 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395296 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395298 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395300 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395303 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395305 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395308 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395310 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395312 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395315 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395317 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395320 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395322 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395329 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395331 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.404695 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395334 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395337 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395339 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395342 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395345 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395347 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395352 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395355 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395358 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395361 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395364 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395367 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395370 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395373 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395375 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395378 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395381 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395383 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395386 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395389 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.405163 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395392 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395394 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395397 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395400 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395402 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395405 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395407 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395409 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395412 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395415 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395417 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395420 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395423 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.395425 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.395431 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.402306 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 13:56:24.405647 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.402323 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.403027 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.403053 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403114 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403119 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403122 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403126 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403130 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403134 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403138 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403142 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403144 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403147 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403151 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403155 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403159 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403162 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403165 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403168 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.406052 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403170 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403173 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403176 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403178 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403181 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403184 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403187 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403189 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403192 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403195 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403198 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403200 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403203 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403207 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403210 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403212 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403215 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403217 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403220 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403223 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.406538 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403225 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403228 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403230 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403233 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403236 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403238 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403241 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403243 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403246 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403248 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403251 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403253 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403256 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403258 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403261 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403266 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403268 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403271 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403273 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.407043 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403276 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403278 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403281 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403286 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403289 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403292 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403295 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403297 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403299 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403302 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403304 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403307 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403309 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403312 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403314 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403317 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403319 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403322 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403324 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.407534 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403327 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403330 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403332 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403334 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403337 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403339 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403341 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403344 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403346 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403349 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403351 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403354 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403356 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403359 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403362 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403364 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403367 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403370 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403373 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403375 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.408055 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403378 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403380 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403383 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.403388 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403499 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403503 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403507 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403510 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403513 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403515 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403518 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403521 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403523 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403525 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403528 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:24.408540 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403530 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403533 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403535 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403539 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403542 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403545 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403548 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403550 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403553 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403555 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403559 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403562 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403565 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403568 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403572 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403575 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403577 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403580 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403583 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:24.408910 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403586 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403588 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403591 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403593 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403596 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403599 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403602 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403605 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403607 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403610 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403613 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403615 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403618 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403620 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403623 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403625 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403628 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403630 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403633 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:24.409373 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403635 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403638 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403640 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403643 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403645 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403647 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403650 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403652 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403655 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403657 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403659 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403662 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403665 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403667 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403670 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403672 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403674 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403677 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403679 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403682 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:24.409819 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403685 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403687 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403690 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403692 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403695 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403697 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403700 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403702 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403708 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403711 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403713 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403716 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403718 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403721 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403723 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403726 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403728 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403731 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403733 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403736 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:24.410360 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403739 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403741 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403744 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403746 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403749 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403752 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403754 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403756 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403759 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:24.403761 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.403766 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.403877 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.405964 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.407743 2562 server.go:1019] "Starting client certificate rotation" Jul 17 13:56:24.410837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.407847 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:24.411276 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.407886 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:24.411276 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.410576 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:24.415788 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.415772 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:24.428515 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.428496 2562 log.go:25] "Validated CRI v1 runtime API" Jul 17 13:56:24.430514 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.430499 2562 log.go:25] "Validated CRI v1 image API" Jul 17 13:56:24.431257 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.431243 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 13:56:24.433536 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.433517 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 98867d4b-c13b-4aec-a0c8-36e4f2ebaaa9:/dev/nvme0n1p4 f7616789-2c00-4373-8617-dc3747ac9cef:/dev/nvme0n1p3] Jul 17 13:56:24.433596 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.433556 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 13:56:24.438751 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.438733 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:24.438867 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.438739 2562 manager.go:216] Machine: {Timestamp:2026-07-17 13:56:24.437284637 +0000 UTC m=+0.313505106 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084621 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260d5a8e22bbe114442954aec46476 SystemUUID:ec260d5a-8e22-bbe1-1444-2954aec46476 BootID:cc902864-1b3c-4ab4-a0f7-faae7be84ed6 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:4a:9b:e0:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:4a:9b:e0:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:2e:d5:f4:f1:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 13:56:24.438922 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.438868 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 13:56:24.438969 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.438956 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 13:56:24.441308 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.441284 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 13:56:24.441450 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.441312 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 13:56:24.442444 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.442433 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 13:56:24.442476 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.442446 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 13:56:24.442476 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.442454 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:24.443071 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.443061 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:24.444624 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.444614 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 13:56:24.447218 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447206 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:24.447386 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447377 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 13:56:24.447418 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447410 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 17 13:56:24.447444 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447429 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 13:56:24.447444 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447442 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 13:56:24.447496 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447451 2562 kubelet.go:398] "Adding apiserver pod source" Jul 17 13:56:24.447496 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447470 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 13:56:24.447845 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447831 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:24.447903 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.447854 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:24.450053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.450026 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 13:56:24.451294 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451281 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 13:56:24.451335 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451312 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 13:56:24.451938 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451927 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 13:56:24.451973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451943 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 13:56:24.451973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451950 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 13:56:24.451973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451959 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 13:56:24.451973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451969 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451976 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451983 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451989 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.451995 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.452000 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.452016 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 13:56:24.452100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.452021 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 13:56:24.452724 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.452715 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 13:56:24.452724 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.452724 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 13:56:24.455972 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.455959 2562 server.go:1268] "Started kubelet" Jul 17 13:56:24.456082 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.456052 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 13:56:24.456135 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.456032 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 13:56:24.456135 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.456110 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 13:56:24.456881 ip-10-0-139-104 systemd[1]: Started Kubernetes Kubelet. Jul 17 13:56:24.460747 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.460705 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 13:56:24.460838 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.460756 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 13:56:24.462069 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.461878 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 13:56:24.462437 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.462355 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 13:56:24.462834 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.462817 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 17 13:56:24.462937 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.462897 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 13:56:24.463994 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.463968 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7b6n" Jul 17 13:56:24.466324 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.465353 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-104.ec2.internal.18c3184a3a704507 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-104.ec2.internal,UID:ip-10-0-139-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-104.ec2.internal,},FirstTimestamp:2026-07-17 13:56:24.455931143 +0000 UTC m=+0.332151611,LastTimestamp:2026-07-17 13:56:24.455931143 +0000 UTC m=+0.332151611,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-104.ec2.internal,}" Jul 17 13:56:24.469020 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.469004 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 13:56:24.469100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.469016 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:24.469220 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.469181 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.469972 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.469957 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 13:56:24.470101 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.469961 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 13:56:24.470101 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.469989 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 13:56:24.470205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.470111 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 17 13:56:24.470205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.470116 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 17 13:56:24.470910 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.470890 2562 factory.go:55] Registering systemd factory Jul 17 13:56:24.471001 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.470913 2562 factory.go:223] Registration of the systemd container factory successfully Jul 17 13:56:24.471205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471188 2562 factory.go:153] Registering CRI-O factory Jul 17 13:56:24.471205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471208 2562 factory.go:223] Registration of the crio container factory successfully Jul 17 13:56:24.471449 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471266 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 13:56:24.471449 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471287 2562 factory.go:103] Registering Raw factory Jul 17 13:56:24.471449 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471297 2562 manager.go:1196] Started watching for new ooms in manager Jul 17 13:56:24.471958 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.471944 2562 manager.go:349] Starting recovery of all containers Jul 17 13:56:24.476391 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.476370 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7b6n" Jul 17 13:56:24.477537 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.477508 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 13:56:24.477815 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.477793 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 13:56:24.481344 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.481329 2562 manager.go:354] Recovery completed Jul 17 13:56:24.485533 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.485516 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.487374 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487356 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.487448 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487390 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.487448 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487402 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.487911 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487900 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 13:56:24.487911 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487911 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 13:56:24.488028 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487926 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:24.488028 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.487930 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.488661 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.488645 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.488740 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.488676 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.488740 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.488691 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.488956 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.488887 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-104.ec2.internal.18c3184a3c500e2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-104.ec2.internal,UID:ip-10-0-139-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-104.ec2.internal,},FirstTimestamp:2026-07-17 13:56:24.48737438 +0000 UTC m=+0.363594852,LastTimestamp:2026-07-17 13:56:24.48737438 +0000 UTC m=+0.363594852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-104.ec2.internal,}" Jul 17 13:56:24.489168 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.489158 2562 policy_none.go:49] "None policy: Start" Jul 17 13:56:24.489209 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.489175 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 13:56:24.489209 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.489188 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 13:56:24.490333 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.490322 2562 policy_none.go:47] "Start" Jul 17 13:56:24.527768 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.527589 2562 manager.go:337] "Starting Device Plugin manager" Jul 17 13:56:24.527883 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.527795 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 13:56:24.527883 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.527810 2562 server.go:87] "Starting device plugin registration server" Jul 17 13:56:24.528099 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.528086 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 13:56:24.528143 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.528100 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 13:56:24.528216 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.528199 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 13:56:24.528302 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.528291 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 13:56:24.528369 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.528303 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 13:56:24.528800 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.528779 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 13:56:24.528896 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.528828 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.598513 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.598480 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 13:56:24.600539 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.599840 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 13:56:24.600539 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.599881 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 13:56:24.600539 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.599909 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 13:56:24.600539 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.599954 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 13:56:24.602715 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.602698 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:24.628996 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.628973 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.630600 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.630581 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.630678 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.630612 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.630678 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.630624 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.630678 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.630646 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.639526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.639481 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.639526 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.639506 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-104.ec2.internal\": node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.649948 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.649926 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.701008 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.700986 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal"] Jul 17 13:56:24.701118 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.701058 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.701922 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.701909 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.701972 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.701936 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.701972 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.701945 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.704168 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.704156 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.704295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.704279 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.704331 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.704314 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.705239 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705220 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.705339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705250 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.705339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705264 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.705339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705288 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.705339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705312 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.705339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.705325 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.707430 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.707407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.707521 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.707447 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:24.708417 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.708403 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:24.708493 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.708427 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:24.708493 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.708443 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:24.728751 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.728728 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-104.ec2.internal\" not found" node="ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.733206 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.733191 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-104.ec2.internal\" not found" node="ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.750654 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.750633 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.771223 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.771190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.771308 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.771231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.771308 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.771255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128787862a299fa7ae74f035b568dfb9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"128787862a299fa7ae74f035b568dfb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.850952 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.850926 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:24.872178 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872147 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.872178 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.872307 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128787862a299fa7ae74f035b568dfb9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"128787862a299fa7ae74f035b568dfb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.872307 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.872307 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6247e749b05f4ea40801dba81d327230-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"6247e749b05f4ea40801dba81d327230\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.872307 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:24.872285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128787862a299fa7ae74f035b568dfb9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"128787862a299fa7ae74f035b568dfb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:24.951536 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:24.951473 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.031092 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.031058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:25.036913 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.036893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:25.052446 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.052418 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.153057 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.153000 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.253512 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.253443 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.334644 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.334613 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:25.354165 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.354129 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.407030 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.407003 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 13:56:25.407519 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.407196 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:25.407519 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.407194 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:25.455146 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.455120 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.485205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.485167 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 13:51:25 +0000 UTC" deadline="2028-03-24 13:52:18.416470416 +0000 UTC" Jul 17 13:56:25.485205 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.485199 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14783h55m52.931274921s" Jul 17 13:56:25.557367 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.557293 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.573920 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:25.573889 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6247e749b05f4ea40801dba81d327230.slice/crio-700e5afca6647ff7928f34d593d11374bb3eead9792f1f0e38642d6201a9f859 WatchSource:0}: Error finding container 700e5afca6647ff7928f34d593d11374bb3eead9792f1f0e38642d6201a9f859: Status 404 returned error can't find the container with id 700e5afca6647ff7928f34d593d11374bb3eead9792f1f0e38642d6201a9f859 Jul 17 13:56:25.580320 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.580300 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:56:25.587903 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:25.587874 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128787862a299fa7ae74f035b568dfb9.slice/crio-8f66fe59c5c3a95fe2d97bdfceb1e156d724d15eda120b22d464fe413c1447dd WatchSource:0}: Error finding container 8f66fe59c5c3a95fe2d97bdfceb1e156d724d15eda120b22d464fe413c1447dd: Status 404 returned error can't find the container with id 8f66fe59c5c3a95fe2d97bdfceb1e156d724d15eda120b22d464fe413c1447dd Jul 17 13:56:25.603851 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.603803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"6247e749b05f4ea40801dba81d327230","Type":"ContainerStarted","Data":"700e5afca6647ff7928f34d593d11374bb3eead9792f1f0e38642d6201a9f859"} Jul 17 13:56:25.604908 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.604889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" event={"ID":"128787862a299fa7ae74f035b568dfb9","Type":"ContainerStarted","Data":"8f66fe59c5c3a95fe2d97bdfceb1e156d724d15eda120b22d464fe413c1447dd"} Jul 17 13:56:25.660182 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.660145 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.763996 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:25.763961 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jul 17 13:56:25.806316 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.806291 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:25.870299 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.870274 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jul 17 13:56:25.882943 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.882919 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:25.884691 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.884678 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jul 17 13:56:25.898800 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.898772 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:25.963691 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:25.963657 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:26.218460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.218362 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:26.448638 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.448610 2562 apiserver.go:52] "Watching apiserver" Jul 17 13:56:26.459336 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.459297 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 13:56:26.460307 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.460267 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-84kvj","kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal","openshift-multus/multus-additional-cni-plugins-5z429","openshift-multus/multus-fzp6v","openshift-network-diagnostics/network-check-target-82dkg","openshift-network-operator/iptables-alerter-tg4kn","kube-system/konnectivity-agent-zf46d","openshift-cluster-node-tuning-operator/tuned-d4sql","openshift-dns/node-resolver-n9k2n","openshift-image-registry/node-ca-xrndt","openshift-multus/network-metrics-daemon-6jk4g","openshift-ovn-kubernetes/ovnkube-node-rb65w"] Jul 17 13:56:26.463580 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.463027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.466048 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.465891 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.466450 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.466426 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.466792 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.466769 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6wfw9\"" Jul 17 13:56:26.466947 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.466928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.467053 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.467010 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:26.470251 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.469220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.470251 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.469832 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:26.472176 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.471498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.472176 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.471649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qpvqf\"" Jul 17 13:56:26.472176 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.471654 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 13:56:26.472176 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.471894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.472176 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.471903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.474250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.474228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.474345 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.474293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.475172 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.475153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 13:56:26.475285 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.475261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8cg6\"" Jul 17 13:56:26.475355 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.475157 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 13:56:26.475774 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.475743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 13:56:26.475868 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.475842 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 13:56:26.476247 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.476228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.476825 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.476806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.477322 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.477305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 13:56:26.477583 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.477570 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.477670 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.477652 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 13:56:26.477805 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.477787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qvww4\"" Jul 17 13:56:26.478009 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.477996 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.478096 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.478071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 13:56:26.479180 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.479160 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 13:56:26.479547 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.479527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.480228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.480211 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5f86\"" Jul 17 13:56:26.482559 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.482538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 13:56:26.482862 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.482648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:26.482862 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.482712 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:26.482862 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.482732 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wtc7c\"" Jul 17 13:56:26.483282 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-ovn\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 13:56:26.483357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-log-socket\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-netns\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-systemd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-node-log\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-netd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnc5\" (UniqueName: \"kubernetes.io/projected/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-kube-api-access-gdnc5\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-systemd-units\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483517 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysconfig\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-kubernetes\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-registration-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-device-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-var-lib-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-etc-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv864\" (UniqueName: \"kubernetes.io/projected/d4dce196-6064-4c71-8070-4c94dc7f896a-kube-api-access-vv864\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-sys-fs\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.483736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-conf\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-run\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-sys\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-socket-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-config\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-script-lib\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-kubelet\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.483970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-slash\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-lib-modules\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-bin\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-env-overrides\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovn-node-metrics-cert\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-var-lib-kubelet\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-host\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-tuned\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pft2\" (UniqueName: \"kubernetes.io/projected/d24dbacc-014c-4015-aeda-5e4f82be7a14-kube-api-access-8pft2\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4md9\" (UniqueName: \"kubernetes.io/projected/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-kube-api-access-r4md9\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-modprobe-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-systemd\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-tmp\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.484491 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.484379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.486253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.485364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.487897 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.487872 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.488492 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.488471 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 13:56:26.488731 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.488711 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6dwj\"" Jul 17 13:56:26.488811 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.488717 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:26.488909 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.488877 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.489133 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.489116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.489206 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.489189 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:26.491429 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.491388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.494041 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.494021 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.499236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.500637 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rnfj\"" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.500945 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.502310 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9qjq\"" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.502397 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:56:26.502585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.502583 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 13:56:26.502932 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.502812 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 13:56:26.528213 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.528189 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2pt5" Jul 17 13:56:26.536497 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.536086 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2pt5" Jul 17 13:56:26.571194 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.571168 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 13:56:26.585028 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.584995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a363112-2dc6-4994-8ad3-7a850746b984-tmp-dir\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.585028 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-netns\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-iptables-alerter-script\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqm8s\" (UniqueName: \"kubernetes.io/projected/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-kube-api-access-sqm8s\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-netns\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysconfig\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-registration-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysconfig\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-var-lib-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-config\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585246 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-registration-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585282 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-var-lib-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-script-lib\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-cnibin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-cni-binary-copy\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-sys-fs\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-conf\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-run\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-sys\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-socket-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f05522c-a515-43f8-b0c2-890d769f0f80-serviceca\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-bin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c2a5820-9e12-4feb-805b-4ae688be1f06-agent-certs\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-kubelet\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585663 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-conf\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.585699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-multus-certs\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a5820-9e12-4feb-805b-4ae688be1f06-konnectivity-ca\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-lib-modules\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585745 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-sys-fs\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-multus\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585808 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-script-lib\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-host\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-kubelet\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a363112-2dc6-4994-8ad3-7a850746b984-hosts-file\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-hostroot\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585889 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovnkube-config\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585947 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-sys\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-run\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585982 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-lib-modules\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-tuned\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.585988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-socket-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.586504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586034 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-host\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586076 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wwdd\" (UniqueName: \"kubernetes.io/projected/4a363112-2dc6-4994-8ad3-7a850746b984-kube-api-access-8wwdd\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-os-release\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586171 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-etc-selinux\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnc5\" (UniqueName: \"kubernetes.io/projected/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-kube-api-access-gdnc5\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-kubelet-config\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586297 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-systemd\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-tmp\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586499 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-systemd\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-log-socket\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-log-socket\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586621 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.587253 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-systemd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-node-log\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-systemd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-netd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwdnz\" (UniqueName: \"kubernetes.io/projected/6f05522c-a515-43f8-b0c2-890d769f0f80-kube-api-access-jwdnz\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586771 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-netd\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586790 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-node-log\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-netns\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-etc-kubernetes\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5kg\" (UniqueName: \"kubernetes.io/projected/3494ee0d-3ff4-4ce0-9216-96617cd08296-kube-api-access-8l5kg\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-systemd-units\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-kubernetes\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-device-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-etc-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587004 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4dce196-6064-4c71-8070-4c94dc7f896a-device-dir\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.588352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-kubernetes\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.586956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-systemd-units\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587043 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-run-ovn-kubernetes\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-dbus\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f05522c-a515-43f8-b0c2-890d769f0f80-host\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587096 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-etc-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv864\" (UniqueName: \"kubernetes.io/projected/d4dce196-6064-4c71-8070-4c94dc7f896a-kube-api-access-vv864\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-os-release\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxn7d\" (UniqueName: \"kubernetes.io/projected/ea6d1541-63bb-4819-a60b-7bc9dc381358-kube-api-access-rxn7d\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-k8s-cni-cncf-io\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-kubelet\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-daemon-config\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-slash\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-system-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-slash\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-conf-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.589210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-bin\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-env-overrides\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovn-node-metrics-cert\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-system-cni-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587689 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-host-cni-bin\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-var-lib-kubelet\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-sysctl-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-var-lib-kubelet\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.587996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-socket-dir-parent\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pft2\" (UniqueName: \"kubernetes.io/projected/d24dbacc-014c-4015-aeda-5e4f82be7a14-kube-api-access-8pft2\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4md9\" (UniqueName: \"kubernetes.io/projected/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-kube-api-access-r4md9\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588095 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-env-overrides\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-cnibin\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.590080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-host-slash\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-modprobe-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588347 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-openvswitch\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-ovn\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588536 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-modprobe-d\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.588603 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-run-ovn\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.588621 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.588724 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.088706407 +0000 UTC m=+2.964926866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:26.590656 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.590139 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-etc-tuned\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.591011 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.590658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d24dbacc-014c-4015-aeda-5e4f82be7a14-tmp\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.593716 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.593691 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-ovn-node-metrics-cert\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.596652 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.596623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnc5\" (UniqueName: \"kubernetes.io/projected/a5aace4b-efce-4ec0-b6ac-d7ecd74efb45-kube-api-access-gdnc5\") pod \"ovnkube-node-rb65w\" (UID: \"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45\") " pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.596786 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.596765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv864\" (UniqueName: \"kubernetes.io/projected/d4dce196-6064-4c71-8070-4c94dc7f896a-kube-api-access-vv864\") pod \"aws-ebs-csi-driver-node-5dh22\" (UID: \"d4dce196-6064-4c71-8070-4c94dc7f896a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.597625 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.597600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pft2\" (UniqueName: \"kubernetes.io/projected/d24dbacc-014c-4015-aeda-5e4f82be7a14-kube-api-access-8pft2\") pod \"tuned-d4sql\" (UID: \"d24dbacc-014c-4015-aeda-5e4f82be7a14\") " pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.605282 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.605251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4md9\" (UniqueName: \"kubernetes.io/projected/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-kube-api-access-r4md9\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:26.688883 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a363112-2dc6-4994-8ad3-7a850746b984-hosts-file\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-hostroot\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wwdd\" (UniqueName: \"kubernetes.io/projected/4a363112-2dc6-4994-8ad3-7a850746b984-kube-api-access-8wwdd\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-os-release\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.688990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-kubelet-config\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwdnz\" (UniqueName: \"kubernetes.io/projected/6f05522c-a515-43f8-b0c2-890d769f0f80-kube-api-access-jwdnz\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.689075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-netns\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-etc-kubernetes\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5kg\" (UniqueName: \"kubernetes.io/projected/3494ee0d-3ff4-4ce0-9216-96617cd08296-kube-api-access-8l5kg\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-dbus\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f05522c-a515-43f8-b0c2-890d769f0f80-host\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-os-release\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxn7d\" (UniqueName: \"kubernetes.io/projected/ea6d1541-63bb-4819-a60b-7bc9dc381358-kube-api-access-rxn7d\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-k8s-cni-cncf-io\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-kubelet\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-daemon-config\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-system-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-conf-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-system-cni-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-socket-dir-parent\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.689460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-cnibin\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-host-slash\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a363112-2dc6-4994-8ad3-7a850746b984-tmp-dir\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-iptables-alerter-script\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqm8s\" (UniqueName: \"kubernetes.io/projected/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-kube-api-access-sqm8s\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-cnibin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-cni-binary-copy\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f05522c-a515-43f8-b0c2-890d769f0f80-serviceca\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-bin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c2a5820-9e12-4feb-805b-4ae688be1f06-agent-certs\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-multus-certs\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a5820-9e12-4feb-805b-4ae688be1f06-konnectivity-ca\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-multus\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-multus\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689827 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a363112-2dc6-4994-8ad3-7a850746b984-hosts-file\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.690077 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.689865 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-hostroot\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-system-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690219 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-etc-kubernetes\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690310 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-os-release\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.690352 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.690426 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.190404479 +0000 UTC m=+3.066624958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-k8s-cni-cncf-io\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-dbus\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690526 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-kubelet\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-socket-dir-parent\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-cnibin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690657 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-os-release\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.690696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-host-slash\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690754 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-var-lib-cni-bin\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51710c31-f7db-4aa6-bf61-ec68e8939d4c-kubelet-config\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690998 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f05522c-a515-43f8-b0c2-890d769f0f80-serviceca\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691064 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691109 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691146 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-daemon-config\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691204 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.690356 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-conf-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691501 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a5820-9e12-4feb-805b-4ae688be1f06-konnectivity-ca\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.691587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691536 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a363112-2dc6-4994-8ad3-7a850746b984-tmp-dir\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.691587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-cnibin\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.691587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-netns\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f05522c-a515-43f8-b0c2-890d769f0f80-host\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.691587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691572 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-host-run-multus-certs\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691836 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691612 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea6d1541-63bb-4819-a60b-7bc9dc381358-system-cni-dir\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.691836 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3494ee0d-3ff4-4ce0-9216-96617cd08296-cni-binary-copy\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.691836 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.691617 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3494ee0d-3ff4-4ce0-9216-96617cd08296-multus-cni-dir\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.692211 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.692185 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-iptables-alerter-script\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.692362 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.692239 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea6d1541-63bb-4819-a60b-7bc9dc381358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.693749 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.693718 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c2a5820-9e12-4feb-805b-4ae688be1f06-agent-certs\") pod \"konnectivity-agent-zf46d\" (UID: \"6c2a5820-9e12-4feb-805b-4ae688be1f06\") " pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.703114 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.702821 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:26.703114 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.702845 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:26.703114 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.702861 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:26.703114 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:26.702939 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.202918759 +0000 UTC m=+3.079139235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:26.703543 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.703507 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wwdd\" (UniqueName: \"kubernetes.io/projected/4a363112-2dc6-4994-8ad3-7a850746b984-kube-api-access-8wwdd\") pod \"node-resolver-n9k2n\" (UID: \"4a363112-2dc6-4994-8ad3-7a850746b984\") " pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.704725 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.704694 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5kg\" (UniqueName: \"kubernetes.io/projected/3494ee0d-3ff4-4ce0-9216-96617cd08296-kube-api-access-8l5kg\") pod \"multus-fzp6v\" (UID: \"3494ee0d-3ff4-4ce0-9216-96617cd08296\") " pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.705908 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.705881 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwdnz\" (UniqueName: \"kubernetes.io/projected/6f05522c-a515-43f8-b0c2-890d769f0f80-kube-api-access-jwdnz\") pod \"node-ca-xrndt\" (UID: \"6f05522c-a515-43f8-b0c2-890d769f0f80\") " pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:26.706053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.706023 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqm8s\" (UniqueName: \"kubernetes.io/projected/8610c315-7cf3-4a63-8db7-c6abdffe9d2a-kube-api-access-sqm8s\") pod \"iptables-alerter-tg4kn\" (UID: \"8610c315-7cf3-4a63-8db7-c6abdffe9d2a\") " pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.706458 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.706436 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxn7d\" (UniqueName: \"kubernetes.io/projected/ea6d1541-63bb-4819-a60b-7bc9dc381358-kube-api-access-rxn7d\") pod \"multus-additional-cni-plugins-5z429\" (UID: \"ea6d1541-63bb-4819-a60b-7bc9dc381358\") " pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.779330 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.779237 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d4sql" Jul 17 13:56:26.788759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.788731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" Jul 17 13:56:26.807609 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.807581 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:26.813494 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.813467 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z429" Jul 17 13:56:26.821316 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.821298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzp6v" Jul 17 13:56:26.830250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.830230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:26.840087 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.840061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg4kn" Jul 17 13:56:26.849807 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.849788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n9k2n" Jul 17 13:56:26.855596 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:26.855578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrndt" Jul 17 13:56:27.093079 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.092975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:27.093246 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.093127 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:27.093246 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.093189 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.093173866 +0000 UTC m=+3.969394327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:27.163813 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.163783 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:27.193562 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.193522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:27.193721 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.193689 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:27.193763 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.193748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.193731392 +0000 UTC m=+4.069951867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:27.294814 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.294780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:27.294979 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.294918 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:27.294979 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.294945 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:27.294979 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.294958 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:27.295158 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.295011 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.294996491 +0000 UTC m=+4.171216948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:27.539802 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.539762 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:27 +0000 UTC" deadline="2028-03-09 02:29:17.449216454 +0000 UTC" Jul 17 13:56:27.539802 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.539796 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14412h32m49.909423708s" Jul 17 13:56:27.600607 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:27.600579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:27.600786 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:27.600704 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:27.756500 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.756316 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4dce196_6064_4c71_8070_4c94dc7f896a.slice/crio-0cec52cbdbe768939088fcbff7f43a81d0fe88fbff73bfffa8fd0684eecbaef9 WatchSource:0}: Error finding container 0cec52cbdbe768939088fcbff7f43a81d0fe88fbff73bfffa8fd0684eecbaef9: Status 404 returned error can't find the container with id 0cec52cbdbe768939088fcbff7f43a81d0fe88fbff73bfffa8fd0684eecbaef9 Jul 17 13:56:27.758768 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.758585 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5aace4b_efce_4ec0_b6ac_d7ecd74efb45.slice/crio-a2bf075e25405668dec9a8e090ac62995434675b84189a95383355d009e13693 WatchSource:0}: Error finding container a2bf075e25405668dec9a8e090ac62995434675b84189a95383355d009e13693: Status 404 returned error can't find the container with id a2bf075e25405668dec9a8e090ac62995434675b84189a95383355d009e13693 Jul 17 13:56:27.763112 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.763087 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8610c315_7cf3_4a63_8db7_c6abdffe9d2a.slice/crio-9d65773600e30cb3625107669919899ae8ad0c510a5c3f5f886157222bb7ba6e WatchSource:0}: Error finding container 9d65773600e30cb3625107669919899ae8ad0c510a5c3f5f886157222bb7ba6e: Status 404 returned error can't find the container with id 9d65773600e30cb3625107669919899ae8ad0c510a5c3f5f886157222bb7ba6e Jul 17 13:56:27.764233 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.764063 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2a5820_9e12_4feb_805b_4ae688be1f06.slice/crio-51b23ab75c6d547d86104bcd5b1870d203df388c905ee4ae49fdeb4d18171b6a WatchSource:0}: Error finding container 51b23ab75c6d547d86104bcd5b1870d203df388c905ee4ae49fdeb4d18171b6a: Status 404 returned error can't find the container with id 51b23ab75c6d547d86104bcd5b1870d203df388c905ee4ae49fdeb4d18171b6a Jul 17 13:56:27.766024 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.765876 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6d1541_63bb_4819_a60b_7bc9dc381358.slice/crio-7bd234fa3530dd5d46f80b65add4c487721fc7ce09a8b322f77f8f413ac2e2a5 WatchSource:0}: Error finding container 7bd234fa3530dd5d46f80b65add4c487721fc7ce09a8b322f77f8f413ac2e2a5: Status 404 returned error can't find the container with id 7bd234fa3530dd5d46f80b65add4c487721fc7ce09a8b322f77f8f413ac2e2a5 Jul 17 13:56:27.773085 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:56:27.772848 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f05522c_a515_43f8_b0c2_890d769f0f80.slice/crio-c623fb950bed217d584feeee1d1991d3ee4d65e93ea21637340293a60025e223 WatchSource:0}: Error finding container c623fb950bed217d584feeee1d1991d3ee4d65e93ea21637340293a60025e223: Status 404 returned error can't find the container with id c623fb950bed217d584feeee1d1991d3ee4d65e93ea21637340293a60025e223 Jul 17 13:56:28.100693 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.100661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:28.100862 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.100840 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.100943 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.100932 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:30.100908912 +0000 UTC m=+5.977129579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.201208 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.201165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:28.201414 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.201280 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.201414 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.201333 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:30.201318573 +0000 UTC m=+6.077539029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.301837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.301792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:28.302059 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.301971 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:28.302059 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.301998 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:28.302059 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.302012 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:28.302263 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.302080 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:30.302059044 +0000 UTC m=+6.178279525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:28.540722 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.540604 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:27 +0000 UTC" deadline="2028-05-03 12:25:02.66712047 +0000 UTC" Jul 17 13:56:28.540722 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.540668 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15742h28m34.126456671s" Jul 17 13:56:28.603192 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.603161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:28.603360 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.603288 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:28.603742 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.603717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:28.603861 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:28.603829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:28.626679 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.626644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n9k2n" event={"ID":"4a363112-2dc6-4994-8ad3-7a850746b984","Type":"ContainerStarted","Data":"50ce79ec2abdaec3913180284b71efece0a0b71c492584cee90fa28f0f27bc0a"} Jul 17 13:56:28.636472 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.636442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zf46d" event={"ID":"6c2a5820-9e12-4feb-805b-4ae688be1f06","Type":"ContainerStarted","Data":"51b23ab75c6d547d86104bcd5b1870d203df388c905ee4ae49fdeb4d18171b6a"} Jul 17 13:56:28.660849 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.660803 2562 generic.go:356] "Generic (PLEG): container finished" podID="6247e749b05f4ea40801dba81d327230" containerID="adbb325a1c64353c288fc4d423147b7060d32868c23c3b43f536ec7716130071" exitCode=0 Jul 17 13:56:28.661014 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.660906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"6247e749b05f4ea40801dba81d327230","Type":"ContainerDied","Data":"adbb325a1c64353c288fc4d423147b7060d32868c23c3b43f536ec7716130071"} Jul 17 13:56:28.676029 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.675990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrndt" event={"ID":"6f05522c-a515-43f8-b0c2-890d769f0f80","Type":"ContainerStarted","Data":"c623fb950bed217d584feeee1d1991d3ee4d65e93ea21637340293a60025e223"} Jul 17 13:56:28.678315 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.678211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d4sql" event={"ID":"d24dbacc-014c-4015-aeda-5e4f82be7a14","Type":"ContainerStarted","Data":"3e87ac44a13e1093e32f5ebf0aa90f3111aedf4274d62e829e23b955d28a3169"} Jul 17 13:56:28.686331 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.686294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerStarted","Data":"7bd234fa3530dd5d46f80b65add4c487721fc7ce09a8b322f77f8f413ac2e2a5"} Jul 17 13:56:28.697578 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.697546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg4kn" event={"ID":"8610c315-7cf3-4a63-8db7-c6abdffe9d2a","Type":"ContainerStarted","Data":"9d65773600e30cb3625107669919899ae8ad0c510a5c3f5f886157222bb7ba6e"} Jul 17 13:56:28.699812 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.699784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"a2bf075e25405668dec9a8e090ac62995434675b84189a95383355d009e13693"} Jul 17 13:56:28.711763 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.711727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" event={"ID":"d4dce196-6064-4c71-8070-4c94dc7f896a","Type":"ContainerStarted","Data":"0cec52cbdbe768939088fcbff7f43a81d0fe88fbff73bfffa8fd0684eecbaef9"} Jul 17 13:56:28.728412 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.728166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzp6v" event={"ID":"3494ee0d-3ff4-4ce0-9216-96617cd08296","Type":"ContainerStarted","Data":"2ef0b7be35a0b83ca3863ea33b0b38f0ea143ea24a7df95e960fb7a6bf9e8de6"} Jul 17 13:56:28.736983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.736953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" event={"ID":"128787862a299fa7ae74f035b568dfb9","Type":"ContainerStarted","Data":"26b47ec89ce2618efdd20093ffc3d613bb4511d2eeffa22a4fc460080ebcfa1f"} Jul 17 13:56:28.752723 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:28.752657 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" podStartSLOduration=2.752634548 podStartE2EDuration="2.752634548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:28.751533969 +0000 UTC m=+4.627754448" watchObservedRunningTime="2026-07-17 13:56:28.752634548 +0000 UTC m=+4.628855032" Jul 17 13:56:29.600647 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:29.600601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:29.601153 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:29.600739 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:29.769753 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:29.769684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"6247e749b05f4ea40801dba81d327230","Type":"ContainerStarted","Data":"2c44bdc3c0ae49e87d13829aeb176ec944898d20239eda45d4f6a2c0c9a7ca7e"} Jul 17 13:56:29.786750 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:29.786692 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" podStartSLOduration=3.786670788 podStartE2EDuration="3.786670788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:29.786668242 +0000 UTC m=+5.662888724" watchObservedRunningTime="2026-07-17 13:56:29.786670788 +0000 UTC m=+5.662891293" Jul 17 13:56:30.119210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:30.119167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:30.119404 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.119331 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:30.119488 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.119406 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:34.119386138 +0000 UTC m=+9.995606595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:30.220476 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:30.220279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:30.220476 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.220440 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:30.220722 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.220509 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:34.220492415 +0000 UTC m=+10.096712878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:30.320787 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:30.320748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:30.321017 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.320995 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:30.321096 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.321025 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:30.321096 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.321038 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:30.321268 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.321123 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:34.321100197 +0000 UTC m=+10.197320671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:30.602989 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:30.602953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:30.603408 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.603128 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:30.603572 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:30.603551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:30.603681 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:30.603660 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:31.600292 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:31.600256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:31.600513 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:31.600406 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:32.600239 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:32.600207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:32.600668 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:32.600327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:32.600781 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:32.600708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:32.600839 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:32.600811 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:33.600584 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:33.600547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:33.601022 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:33.600699 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:34.157532 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:34.156894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:34.157532 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.157128 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:34.157532 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.157193 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:42.157175059 +0000 UTC m=+18.033395521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:34.257936 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:34.257896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:34.258161 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.258101 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:34.258222 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.258173 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:42.258150326 +0000 UTC m=+18.134370783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:34.358513 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:34.358475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:34.358717 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.358667 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:34.358717 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.358693 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:34.358717 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.358707 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:34.358885 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.358768 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:42.358748049 +0000 UTC m=+18.234968512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:34.601700 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:34.601667 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:34.602093 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.601776 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:34.602093 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:34.602050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:34.602189 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:34.602151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:35.600931 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:35.600895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:35.601138 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:35.601060 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:36.603231 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:36.603186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:36.603720 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:36.603339 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:36.603783 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:36.603752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:36.603905 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:36.603847 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:37.600236 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:37.600202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:37.600412 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:37.600321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:38.600957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:38.600924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:38.601346 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:38.601089 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:38.601494 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:38.601470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:38.601618 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:38.601575 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:39.600391 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:39.600353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:39.600585 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:39.600489 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:40.600956 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:40.600918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:40.601403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:40.600970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:40.601403 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:40.601052 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:40.601403 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:40.601192 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:41.600530 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:41.600501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:41.600754 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:41.600627 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:42.224195 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:42.224156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:42.224749 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.224298 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:42.224749 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.224362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.224341692 +0000 UTC m=+34.100562162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:42.324844 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:42.324812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:42.325000 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.324963 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:42.325072 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.325024 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.325005811 +0000 UTC m=+34.201226269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:42.425955 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:42.425921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:42.426152 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.426128 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:42.426221 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.426155 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:42.426221 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.426169 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:42.426320 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.426233 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.426213637 +0000 UTC m=+34.302434105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:42.600771 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:42.600731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:42.600924 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.600874 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:42.600983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:42.600923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:42.601026 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:42.601013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:43.600905 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:43.600874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:43.601423 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:43.601001 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:44.601546 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:44.601504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:44.601994 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:44.601617 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:44.601994 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:44.601674 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:44.601994 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:44.601776 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:45.601202 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:45.601168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:45.601387 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:45.601293 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:46.600526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:46.600481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:46.600526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:46.600502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:46.601134 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:46.600611 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:46.601134 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:46.600752 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:47.600732 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:47.600699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:47.601170 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:47.600847 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:48.601737 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.601375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:48.602591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.601383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:48.602591 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:48.601847 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:48.602591 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:48.601895 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:48.817658 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.817472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrndt" event={"ID":"6f05522c-a515-43f8-b0c2-890d769f0f80","Type":"ContainerStarted","Data":"381cdf6ab6b0726d1f97a40d3e6ce5194da158224329559cd709f8061059a836"} Jul 17 13:56:48.819262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.819227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d4sql" event={"ID":"d24dbacc-014c-4015-aeda-5e4f82be7a14","Type":"ContainerStarted","Data":"87c7450da2f8195c173b2371c770e5f1315e84a2db9a8c4e27ef27446746c566"} Jul 17 13:56:48.821025 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.820996 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="ab9f877248e448f31d5fce76dbff11201bc7cacd3d13547d4ffa6582106a4e3d" exitCode=0 Jul 17 13:56:48.821156 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.821076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"ab9f877248e448f31d5fce76dbff11201bc7cacd3d13547d4ffa6582106a4e3d"} Jul 17 13:56:48.824571 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"0c27d93f1dabc0042021e9056afc231c5eb6f96e76bacf395dff62f2e0838382"} Jul 17 13:56:48.824654 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"f53e8f5a9483ca712b67f666f3a8a6eb4f1ffd90e12e8ca6c2edadf8264d5c49"} Jul 17 13:56:48.824697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"db01bbdb557c0f255935a4bb8e34adf3a528ad770d6f0c82da6f7a7738356614"} Jul 17 13:56:48.824729 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"f486e3be82e95d13b511f257c353eac761a30c834966b063a99bf01e34f67294"} Jul 17 13:56:48.824763 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"872e8323635048af468eac8135e77a6f2ed44d7f7cf480cd70aba6b27cc21065"} Jul 17 13:56:48.824795 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.824778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"f134f51da5448ce2a8cde3c3759fc00f1bb7fa82af83f9cc33ec9d0f26544152"} Jul 17 13:56:48.825822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.825797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" event={"ID":"d4dce196-6064-4c71-8070-4c94dc7f896a","Type":"ContainerStarted","Data":"99628f2173d653ff5f94e2f6991c23be1c3eb0b712bfb50d16144c8f859726a3"} Jul 17 13:56:48.827268 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.827245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzp6v" event={"ID":"3494ee0d-3ff4-4ce0-9216-96617cd08296","Type":"ContainerStarted","Data":"54be3296542def6afd184cfb3315b2f2f4534cbf7e2d406b79e48343d5662b17"} Jul 17 13:56:48.828567 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.828547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n9k2n" event={"ID":"4a363112-2dc6-4994-8ad3-7a850746b984","Type":"ContainerStarted","Data":"052fe5faf192d228659d515b75694bfdbdc926506d4358fc671cc9b6420bdc84"} Jul 17 13:56:48.829754 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.829735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zf46d" event={"ID":"6c2a5820-9e12-4feb-805b-4ae688be1f06","Type":"ContainerStarted","Data":"bee0da572f0bc01e0c0b789e80177525067645c8a63157879cf4669161c9e835"} Jul 17 13:56:48.849394 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.849347 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xrndt" podStartSLOduration=3.928732417 podStartE2EDuration="23.849335055s" totalImagesPullingTime="19.920602638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:48.832673535 +0000 UTC m=+24.708894012" watchObservedRunningTime="2026-07-17 13:56:48.849335055 +0000 UTC m=+24.725555533" Jul 17 13:56:48.849898 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.849873 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d4sql" podStartSLOduration=3.9054640320000003 podStartE2EDuration="23.849867309s" totalImagesPullingTime="19.944403277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:48.849214045 +0000 UTC m=+24.725434522" watchObservedRunningTime="2026-07-17 13:56:48.849867309 +0000 UTC m=+24.726087788" Jul 17 13:56:48.864623 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.864580 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n9k2n" podStartSLOduration=3.943102279 podStartE2EDuration="23.864567709s" totalImagesPullingTime="19.92146543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:48.864157833 +0000 UTC m=+24.740378311" watchObservedRunningTime="2026-07-17 13:56:48.864567709 +0000 UTC m=+24.740788186" Jul 17 13:56:48.910522 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:48.910469 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fzp6v" podStartSLOduration=3.896573332 podStartE2EDuration="23.910454629s" totalImagesPullingTime="20.013881297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:48.909805154 +0000 UTC m=+24.786025632" watchObservedRunningTime="2026-07-17 13:56:48.910454629 +0000 UTC m=+24.786675119" Jul 17 13:56:49.276782 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.276757 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 13:56:49.540499 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.540345 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T13:56:49.276775268Z","UUID":"85b8d95a-c592-4ba1-8ba7-677cbbacf4f1","Handler":null,"Name":"","Endpoint":""} Jul 17 13:56:49.541766 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.541745 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 13:56:49.541897 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.541788 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 13:56:49.600332 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.600303 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:49.600476 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:49.600418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:49.834788 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.834697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg4kn" event={"ID":"8610c315-7cf3-4a63-8db7-c6abdffe9d2a","Type":"ContainerStarted","Data":"768bcd1c97c94cc6014adba8f37b643364eee8732752017226afd85273406b4c"} Jul 17 13:56:49.837278 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.837241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" event={"ID":"d4dce196-6064-4c71-8070-4c94dc7f896a","Type":"ContainerStarted","Data":"cd50f53ff7166b2c844bc7c453fd73edeab126c3694bb7a02430ce20e545b891"} Jul 17 13:56:49.856478 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.856428 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tg4kn" podStartSLOduration=4.925619356 podStartE2EDuration="24.856414805s" totalImagesPullingTime="19.930795449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.855910932 +0000 UTC m=+25.732131409" watchObservedRunningTime="2026-07-17 13:56:49.856414805 +0000 UTC m=+25.732635312" Jul 17 13:56:49.856639 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:49.856504 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zf46d" podStartSLOduration=8.623170167 podStartE2EDuration="24.856497971s" totalImagesPullingTime="16.233327804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:48.925282921 +0000 UTC m=+24.801503397" watchObservedRunningTime="2026-07-17 13:56:49.856497971 +0000 UTC m=+25.732718508" Jul 17 13:56:50.161955 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.161927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:50.600617 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.600590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:50.600759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.600590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:50.600759 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:50.600739 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:50.600872 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:50.600757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:50.723272 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.723150 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:50.723754 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.723732 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:50.843081 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.843052 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"fce7804c4dbfd5ce7a81d3149ccfdf213b22d19d34ccb6861d3b93dbb51a7e83"} Jul 17 13:56:50.845478 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.845441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" event={"ID":"d4dce196-6064-4c71-8070-4c94dc7f896a","Type":"ContainerStarted","Data":"a73816445e2137069415e25ca320394ee400127def2035e613463e550239f8cc"} Jul 17 13:56:50.846231 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.846210 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zf46d" Jul 17 13:56:50.863404 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:50.863348 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5dh22" podStartSLOduration=3.723552267 podStartE2EDuration="25.863334188s" totalImagesPullingTime="22.139781921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:50.863127761 +0000 UTC m=+26.739348240" watchObservedRunningTime="2026-07-17 13:56:50.863334188 +0000 UTC m=+26.739554705" Jul 17 13:56:51.601070 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:51.601025 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:51.601274 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:51.601160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:52.600425 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:52.600391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:52.600835 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:52.600536 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:52.600835 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:52.600542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:52.600835 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:52.600622 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:53.600343 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.600178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:53.600515 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:53.600418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:53.854609 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.854528 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="1e35f9f2c29a10f36e71afd3e42267c69534995e199a06048e336e2459751047" exitCode=0 Jul 17 13:56:53.854609 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.854593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"1e35f9f2c29a10f36e71afd3e42267c69534995e199a06048e336e2459751047"} Jul 17 13:56:53.858430 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.858404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" event={"ID":"a5aace4b-efce-4ec0-b6ac-d7ecd74efb45","Type":"ContainerStarted","Data":"8a5f22e2cf11cc9f99cd9526d8a54669bd7512ab30fb264909f556121337b4d8"} Jul 17 13:56:53.858695 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.858678 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:53.858771 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.858740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:53.874456 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.874430 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:53.874571 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.874536 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:53.911377 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:53.911303 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" podStartSLOduration=8.909145164 podStartE2EDuration="28.911281252s" totalImagesPullingTime="20.002136088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:53.910071907 +0000 UTC m=+29.786292384" watchObservedRunningTime="2026-07-17 13:56:53.911281252 +0000 UTC m=+29.787501729" Jul 17 13:56:54.601907 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:54.601152 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:54.601907 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:54.601450 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:54.601907 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:54.601230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:54.601907 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:54.601865 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:54.813425 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:54.813397 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:56:55.281861 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.281780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jk4g"] Jul 17 13:56:55.282017 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.281884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:55.282017 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:55.281981 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:55.285166 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.285140 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82dkg"] Jul 17 13:56:55.285303 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.285234 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:55.285368 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:55.285330 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:55.296367 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.296339 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84kvj"] Jul 17 13:56:55.296504 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.296434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:55.296573 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:55.296518 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:55.865196 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.865165 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="09226fe0900fab194b27fad7f72d15edfded0f938c488c654c26c0942cdbd1ba" exitCode=0 Jul 17 13:56:55.865649 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:55.865244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"09226fe0900fab194b27fad7f72d15edfded0f938c488c654c26c0942cdbd1ba"} Jul 17 13:56:56.601327 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:56.600789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:56.601327 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:56.600941 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:56.601327 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:56.601065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:56.601327 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:56.601212 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:57.600645 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:57.600601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:57.600998 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:57.600722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:56:57.872853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:57.872824 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="30a0c1839eb4bea1578a195478402912632984df1aa22a6c2f9c811dd596dd07" exitCode=0 Jul 17 13:56:57.873071 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:57.872860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"30a0c1839eb4bea1578a195478402912632984df1aa22a6c2f9c811dd596dd07"} Jul 17 13:56:58.249099 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:58.249011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:58.249245 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.249159 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:58.249245 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.249222 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs podName:c62068b8-28bf-425d-8fc7-8ce2d3d78eb3 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:30.249206295 +0000 UTC m=+66.125426754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs") pod "network-metrics-daemon-6jk4g" (UID: "c62068b8-28bf-425d-8fc7-8ce2d3d78eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:58.349688 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:58.349654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:58.349882 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.349827 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:58.349940 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.349898 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret podName:51710c31-f7db-4aa6-bf61-ec68e8939d4c nodeName:}" failed. No retries permitted until 2026-07-17 13:57:30.349876432 +0000 UTC m=+66.226096889 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret") pod "global-pull-secret-syncer-84kvj" (UID: "51710c31-f7db-4aa6-bf61-ec68e8939d4c") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:58.450799 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:58.450763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:58.450984 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.450934 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:58.450984 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.450954 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:58.450984 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.450964 2562 projected.go:196] Error preparing data for projected volume kube-api-access-72s8z for pod openshift-network-diagnostics/network-check-target-82dkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:58.451147 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.451018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z podName:c96fe36d-9d60-4150-bda2-522c86a4a067 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:30.451003174 +0000 UTC m=+66.327223630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-72s8z" (UniqueName: "kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z") pod "network-check-target-82dkg" (UID: "c96fe36d-9d60-4150-bda2-522c86a4a067") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:58.600761 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:58.600728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:56:58.601244 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:58.600763 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:56:58.601244 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.600874 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84kvj" podUID="51710c31-f7db-4aa6-bf61-ec68e8939d4c" Jul 17 13:56:58.601244 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:58.601018 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jk4g" podUID="c62068b8-28bf-425d-8fc7-8ce2d3d78eb3" Jul 17 13:56:59.600728 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:56:59.600543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:56:59.600922 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:56:59.600819 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82dkg" podUID="c96fe36d-9d60-4150-bda2-522c86a4a067" Jul 17 13:57:00.490075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.489971 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeReady" Jul 17 13:57:00.490222 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.490148 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 13:57:00.536786 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.536753 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75d766bb8f-wmv7f"] Jul 17 13:57:00.539536 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.539518 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.543785 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.543754 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x2msr"] Jul 17 13:57:00.544795 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.544759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 13:57:00.545001 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.544983 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 13:57:00.545133 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.545062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dzmb\"" Jul 17 13:57:00.545133 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.545098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 13:57:00.545452 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.545431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.545587 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.545570 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dqbrl"] Jul 17 13:57:00.548674 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.548652 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 13:57:00.548674 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.548664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.548935 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.548916 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 13:57:00.549069 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.548669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf4sj\"" Jul 17 13:57:00.549273 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.549257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 13:57:00.551110 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.551090 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 13:57:00.551312 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.551293 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 13:57:00.551389 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.551334 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn6fd\"" Jul 17 13:57:00.551740 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.551514 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 13:57:00.558152 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.557962 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75d766bb8f-wmv7f"] Jul 17 13:57:00.558614 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.558597 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dqbrl"] Jul 17 13:57:00.572420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.572393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2msr"] Jul 17 13:57:00.605171 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.605143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:57:00.605655 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.605320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:57:00.607941 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.607921 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:57:00.608119 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.607977 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:57:00.608119 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.608025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:57:00.666842 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.666842 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pk6s\" (UniqueName: \"kubernetes.io/projected/cbc68c11-7261-491d-bebb-0567d3bfda84-kube-api-access-2pk6s\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.666976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667088 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbc68c11-7261-491d-bebb-0567d3bfda84-cert\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9zn\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43187e8d-dcd5-4371-bbb7-53187af7db74-tmp-dir\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b75j\" (UniqueName: \"kubernetes.io/projected/43187e8d-dcd5-4371-bbb7-53187af7db74-kube-api-access-2b75j\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.667295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.667265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43187e8d-dcd5-4371-bbb7-53187af7db74-config-volume\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.767945 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.767852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.767945 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.767905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.767945 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.767937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.767970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pk6s\" (UniqueName: \"kubernetes.io/projected/cbc68c11-7261-491d-bebb-0567d3bfda84-kube-api-access-2pk6s\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.767993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbc68c11-7261-491d-bebb-0567d3bfda84-cert\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9zn\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768229 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43187e8d-dcd5-4371-bbb7-53187af7db74-tmp-dir\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.768523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.768523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b75j\" (UniqueName: \"kubernetes.io/projected/43187e8d-dcd5-4371-bbb7-53187af7db74-kube-api-access-2b75j\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.768523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43187e8d-dcd5-4371-bbb7-53187af7db74-config-volume\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.768922 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.768902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43187e8d-dcd5-4371-bbb7-53187af7db74-config-volume\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.769027 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:00.769014 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:00.769116 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:00.769105 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:01.26908651 +0000 UTC m=+37.145306969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:00.769719 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.769699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.770183 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:00.770277 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:00.770289 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:00.770323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:01.270312453 +0000 UTC m=+37.146532908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.770405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43187e8d-dcd5-4371-bbb7-53187af7db74-tmp-dir\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.771066 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.771002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.775134 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.775111 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.775258 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.775118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.775258 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.775173 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbc68c11-7261-491d-bebb-0567d3bfda84-cert\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.782777 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.782751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.783216 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.783187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9zn\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:00.784297 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.784268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b75j\" (UniqueName: \"kubernetes.io/projected/43187e8d-dcd5-4371-bbb7-53187af7db74-kube-api-access-2b75j\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:00.785093 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.785069 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pk6s\" (UniqueName: \"kubernetes.io/projected/cbc68c11-7261-491d-bebb-0567d3bfda84-kube-api-access-2pk6s\") pod \"ingress-canary-dqbrl\" (UID: \"cbc68c11-7261-491d-bebb-0567d3bfda84\") " pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:00.870051 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:00.869997 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dqbrl" Jul 17 13:57:01.089973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.089900 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6"] Jul 17 13:57:01.091720 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.091694 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.096446 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.096426 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xbqb4\"" Jul 17 13:57:01.096567 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.096455 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 13:57:01.096784 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.096767 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 13:57:01.104057 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.104008 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6"] Jul 17 13:57:01.172830 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.172799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.173014 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.172839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/daa27b01-9461-404d-aea5-030a2ef12ea5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.273506 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.273459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:01.273506 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.273508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273620 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273637 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.273650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/daa27b01-9461-404d-aea5-030a2ef12ea5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273659 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273675 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:01.773657776 +0000 UTC m=+37.649878233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:01.273760 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273732 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:02.273714365 +0000 UTC m=+38.149934823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:01.273986 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.273776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:01.273986 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273882 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:01.273986 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.273929 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:02.273916666 +0000 UTC m=+38.150137121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:01.274436 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.274415 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/daa27b01-9461-404d-aea5-030a2ef12ea5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.601058 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.601009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:57:01.604182 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.604158 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:57:01.604311 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.604211 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:57:01.604311 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.604250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:57:01.778929 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.778895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:01.779468 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.779065 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:01.779468 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:01.779132 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:02.779115391 +0000 UTC m=+38.655335848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:01.928762 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:01.928569 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dqbrl"] Jul 17 13:57:01.933743 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:01.933713 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc68c11_7261_491d_bebb_0567d3bfda84.slice/crio-8ee050d70e8c8532384c951503f4ff218170bf00935ef5e02b3a99c192c5975b WatchSource:0}: Error finding container 8ee050d70e8c8532384c951503f4ff218170bf00935ef5e02b3a99c192c5975b: Status 404 returned error can't find the container with id 8ee050d70e8c8532384c951503f4ff218170bf00935ef5e02b3a99c192c5975b Jul 17 13:57:02.283243 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.283133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:02.283243 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.283211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:02.283413 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.283303 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:02.283413 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.283302 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:02.283413 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.283318 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:02.283413 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.283371 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.283356336 +0000 UTC m=+40.159576798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:02.283413 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.283386 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.283380202 +0000 UTC m=+40.159600657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:02.787055 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.787014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:02.787735 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.787172 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:02.787735 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:02.787243 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.787225392 +0000 UTC m=+40.663445868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:02.894614 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.894575 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="f556d9567d451ccd62fb4b86b139e7f2e156282249c418cca3714d8630254873" exitCode=0 Jul 17 13:57:02.894792 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.894657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"f556d9567d451ccd62fb4b86b139e7f2e156282249c418cca3714d8630254873"} Jul 17 13:57:02.896503 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:02.896476 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dqbrl" event={"ID":"cbc68c11-7261-491d-bebb-0567d3bfda84","Type":"ContainerStarted","Data":"8ee050d70e8c8532384c951503f4ff218170bf00935ef5e02b3a99c192c5975b"} Jul 17 13:57:03.903498 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:03.903465 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea6d1541-63bb-4819-a60b-7bc9dc381358" containerID="3a1106680fdda7e1e29ea6989218bf378526b83b6c2de3134f3a20b609c1c1bb" exitCode=0 Jul 17 13:57:03.903991 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:03.903533 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerDied","Data":"3a1106680fdda7e1e29ea6989218bf378526b83b6c2de3134f3a20b609c1c1bb"} Jul 17 13:57:04.301733 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.301698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:04.301917 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.301778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:04.301917 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.301871 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:04.301917 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.301866 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:04.302088 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.301954 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.301933892 +0000 UTC m=+44.178154346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:04.302088 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.301881 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:04.302088 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.302018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.302005236 +0000 UTC m=+44.178225692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:04.806439 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.806197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:04.806589 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.806342 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:04.806589 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:04.806557 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.806541869 +0000 UTC m=+44.682762325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:04.907696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.907647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dqbrl" event={"ID":"cbc68c11-7261-491d-bebb-0567d3bfda84","Type":"ContainerStarted","Data":"043e62deb249e94b3fa7475230e5a8093640d90846b12286d80485006e087f47"} Jul 17 13:57:04.911732 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.911707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z429" event={"ID":"ea6d1541-63bb-4819-a60b-7bc9dc381358","Type":"ContainerStarted","Data":"3b13d7ccae8a692a6c1b97f37a27c165bc9d079f0bd7be7479c1eb25ffda559c"} Jul 17 13:57:04.928100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.928031 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dqbrl" podStartSLOduration=2.439827569 podStartE2EDuration="4.928014828s" totalImagesPullingTime="2.488187259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:04.927967456 +0000 UTC m=+40.804187932" watchObservedRunningTime="2026-07-17 13:57:04.928014828 +0000 UTC m=+40.804235286" Jul 17 13:57:04.951751 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:04.951650 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5z429" podStartSLOduration=9.593432436 podStartE2EDuration="39.951635122s" totalImagesPullingTime="30.358202686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:04.951563267 +0000 UTC m=+40.827783745" watchObservedRunningTime="2026-07-17 13:57:04.951635122 +0000 UTC m=+40.827855598" Jul 17 13:57:07.191610 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.191577 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h4gl5"] Jul 17 13:57:07.227522 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.227494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.241376 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.241351 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 13:57:07.241534 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.241359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 13:57:07.241534 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.241432 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 13:57:07.242706 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.242686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 13:57:07.242790 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.242689 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hg4xg\"" Jul 17 13:57:07.247681 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.247663 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4gl5"] Jul 17 13:57:07.325420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.325381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.325575 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.325471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-data-volume\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.325575 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.325487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.325575 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.325504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jml5q\" (UniqueName: \"kubernetes.io/projected/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-api-access-jml5q\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.325575 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.325532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-crio-socket\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426083 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426242 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-data-volume\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426242 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426242 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jml5q\" (UniqueName: \"kubernetes.io/projected/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-api-access-jml5q\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426242 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.426190 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.426242 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-crio-socket\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426416 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.426265 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.926244203 +0000 UTC m=+43.802464660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.426416 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.426277 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.426416 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.426349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.926335855 +0000 UTC m=+43.802556314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : configmap "kube-rbac-proxy" not found Jul 17 13:57:07.426522 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-crio-socket\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.426571 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.426551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-data-volume\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.442297 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.442229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jml5q\" (UniqueName: \"kubernetes.io/projected/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-api-access-jml5q\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.930611 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.930586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.930774 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:07.930649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:07.930774 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.930740 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.930774 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.930743 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.930883 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.930798 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.93078097 +0000 UTC m=+44.807001448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.930883 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:07.930812 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.930805661 +0000 UTC m=+44.807026120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : configmap "kube-rbac-proxy" not found Jul 17 13:57:08.334666 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:08.334587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:08.334666 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:08.334654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:08.335078 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.334753 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:08.335078 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.334775 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:08.335078 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.334824 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:16.334808649 +0000 UTC m=+52.211029127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:08.335078 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.334759 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:08.335078 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.334885 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:16.334870781 +0000 UTC m=+52.211091239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:08.838351 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:08.838311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:08.838530 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.838440 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:08.838530 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.838495 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:16.838481666 +0000 UTC m=+52.714702121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:08.939379 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:08.939348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:08.939497 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:08.939419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:08.939549 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.939488 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:08.939549 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.939526 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:08.939611 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.939563 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.939546603 +0000 UTC m=+46.815767061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : configmap "kube-rbac-proxy" not found Jul 17 13:57:08.939611 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:08.939577 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.939571507 +0000 UTC m=+46.815791962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:09.379484 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.379451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4dz9"] Jul 17 13:57:09.393018 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.392988 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4dz9"] Jul 17 13:57:09.393168 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.393097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.396057 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.396013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 17 13:57:09.396190 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.396013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 17 13:57:09.396992 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.396976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vp22g\"" Jul 17 13:57:09.397068 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.396986 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 17 13:57:09.397122 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.397105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 17 13:57:09.543446 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.543412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-key\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.543605 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.543472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-cabundle\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.543605 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.543517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zndw\" (UniqueName: \"kubernetes.io/projected/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-kube-api-access-8zndw\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.644646 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.644569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-key\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.644646 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.644617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-cabundle\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.644893 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.644734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zndw\" (UniqueName: \"kubernetes.io/projected/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-kube-api-access-8zndw\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.645250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.645233 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-cabundle\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.647117 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.647101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-signing-key\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.653228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.653203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zndw\" (UniqueName: \"kubernetes.io/projected/a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c-kube-api-access-8zndw\") pod \"service-ca-58598695f7-f4dz9\" (UID: \"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c\") " pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.702079 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.702055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-f4dz9" Jul 17 13:57:09.849669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.849638 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-f4dz9"] Jul 17 13:57:09.853610 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:09.853582 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fc1a46_8993_4d2e_bec9_9d76b2fcd07c.slice/crio-498314687bbe6b82b4a7925f1d432a2bdda4ef59a1cd2cb2a0562faee3556deb WatchSource:0}: Error finding container 498314687bbe6b82b4a7925f1d432a2bdda4ef59a1cd2cb2a0562faee3556deb: Status 404 returned error can't find the container with id 498314687bbe6b82b4a7925f1d432a2bdda4ef59a1cd2cb2a0562faee3556deb Jul 17 13:57:09.924259 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.924183 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n9k2n_4a363112-2dc6-4994-8ad3-7a850746b984/dns-node-resolver/0.log" Jul 17 13:57:09.925498 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:09.925468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f4dz9" event={"ID":"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c","Type":"ContainerStarted","Data":"498314687bbe6b82b4a7925f1d432a2bdda4ef59a1cd2cb2a0562faee3556deb"} Jul 17 13:57:10.960682 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:10.960648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:10.961143 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:10.960723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:10.961143 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:10.960788 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:10.961143 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:10.960796 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:10.961143 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:10.960838 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.960824118 +0000 UTC m=+50.837044574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : configmap "kube-rbac-proxy" not found Jul 17 13:57:10.961143 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:10.960851 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.960844264 +0000 UTC m=+50.837064718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:11.124711 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:11.124687 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrndt_6f05522c-a515-43f8-b0c2-890d769f0f80/node-ca/0.log" Jul 17 13:57:11.724983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:11.724958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dqbrl_cbc68c11-7261-491d-bebb-0567d3bfda84/serve-healthcheck-canary/0.log" Jul 17 13:57:12.933360 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:12.933330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-f4dz9" event={"ID":"a5fc1a46-8993-4d2e-bec9-9d76b2fcd07c","Type":"ContainerStarted","Data":"0b37692a93c43d4d70c1fcab755aa68ae9b0c7268de8225c5a2dcf3334fec8b2"} Jul 17 13:57:14.996443 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:14.996401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:14.996831 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:14.996487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:14.996831 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:14.996558 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.996831 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:14.996638 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls podName:d85cba3a-565f-48f2-9214-3e8a9c1e9d99 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:22.996620449 +0000 UTC m=+58.872840904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h4gl5" (UID: "d85cba3a-565f-48f2-9214-3e8a9c1e9d99") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.996954 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:14.996937 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:16.406405 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:16.406365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:16.406443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") pod \"image-registry-75d766bb8f-wmv7f\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.406539 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.406563 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75d766bb8f-wmv7f: secret "image-registry-tls" not found Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.406613 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls podName:ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:32.406598356 +0000 UTC m=+68.282818858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls") pod "image-registry-75d766bb8f-wmv7f" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395") : secret "image-registry-tls" not found Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.406541 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:16.406879 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.406710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls podName:43187e8d-dcd5-4371-bbb7-53187af7db74 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:32.406688777 +0000 UTC m=+68.282909259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls") pod "dns-default-x2msr" (UID: "43187e8d-dcd5-4371-bbb7-53187af7db74") : secret "dns-default-metrics-tls" not found Jul 17 13:57:16.911004 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:16.910966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:16.911253 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.911152 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:57:16.911253 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:16.911221 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert podName:daa27b01-9461-404d-aea5-030a2ef12ea5 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:32.911199968 +0000 UTC m=+68.787420423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-hp4k6" (UID: "daa27b01-9461-404d-aea5-030a2ef12ea5") : secret "networking-console-plugin-cert" not found Jul 17 13:57:23.063404 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.063328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:23.065988 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.065961 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d85cba3a-565f-48f2-9214-3e8a9c1e9d99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4gl5\" (UID: \"d85cba3a-565f-48f2-9214-3e8a9c1e9d99\") " pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:23.136912 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.136859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4gl5" Jul 17 13:57:23.273527 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.273471 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-f4dz9" podStartSLOduration=11.90542239 podStartE2EDuration="14.273455133s" totalImagesPullingTime="2.368032743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:12.953401409 +0000 UTC m=+48.829621877" watchObservedRunningTime="2026-07-17 13:57:23.273455133 +0000 UTC m=+59.149675610" Jul 17 13:57:23.273715 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.273696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4gl5"] Jul 17 13:57:23.277758 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:23.277729 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85cba3a_565f_48f2_9214_3e8a9c1e9d99.slice/crio-d457707a4fe3697575695d3cee8c3dbc8e6691f2d7fa9bae68990ae19dc5cd12 WatchSource:0}: Error finding container d457707a4fe3697575695d3cee8c3dbc8e6691f2d7fa9bae68990ae19dc5cd12: Status 404 returned error can't find the container with id d457707a4fe3697575695d3cee8c3dbc8e6691f2d7fa9bae68990ae19dc5cd12 Jul 17 13:57:23.963460 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:23.963418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4gl5" event={"ID":"d85cba3a-565f-48f2-9214-3e8a9c1e9d99","Type":"ContainerStarted","Data":"d457707a4fe3697575695d3cee8c3dbc8e6691f2d7fa9bae68990ae19dc5cd12"} Jul 17 13:57:25.880313 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:25.880281 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rb65w" Jul 17 13:57:28.978678 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:28.978621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4gl5" event={"ID":"d85cba3a-565f-48f2-9214-3e8a9c1e9d99","Type":"ContainerStarted","Data":"3c9e76ddc4c5258e047f235fd4c3551ec2103ee4dd51e8a8fddd80a7f718e52d"} Jul 17 13:57:30.284053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.284001 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75d766bb8f-wmv7f"] Jul 17 13:57:30.284439 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:30.284283 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" podUID="ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" Jul 17 13:57:30.287087 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.287062 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6tngg"] Jul 17 13:57:30.304147 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.304115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:30.312548 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.312090 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 13:57:30.312548 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.312114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 13:57:30.312548 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.312309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ld8kb\"" Jul 17 13:57:30.314643 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.314617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6tngg"] Jul 17 13:57:30.322468 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.322441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:57:30.325210 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.325185 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:57:30.336254 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.336224 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c62068b8-28bf-425d-8fc7-8ce2d3d78eb3-metrics-certs\") pod \"network-metrics-daemon-6jk4g\" (UID: \"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3\") " pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:57:30.360007 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.359982 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56cc77d8b7-xmfnx"] Jul 17 13:57:30.365524 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.365504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.376085 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.376063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cc77d8b7-xmfnx"] Jul 17 13:57:30.423254 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-tls\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423254 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-bound-sa-token\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423508 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnp85\" (UniqueName: \"kubernetes.io/projected/5f5e4699-477d-4646-9fd0-bbc9fa9ff05c-kube-api-access-nnp85\") pod \"downloads-5bc67dcd46-6tngg\" (UID: \"5f5e4699-477d-4646-9fd0-bbc9fa9ff05c\") " pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:30.423508 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-trusted-ca\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423508 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-installation-pull-secrets\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423508 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-certificates\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-image-registry-private-configuration\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:57:30.423697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c01021aa-2079-4e70-93e6-ffa9945439e7-ca-trust-extracted\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.423825 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.423760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f79f\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-kube-api-access-8f79f\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.426637 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.426616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:57:30.437306 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.437282 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51710c31-f7db-4aa6-bf61-ec68e8939d4c-original-pull-secret\") pod \"global-pull-secret-syncer-84kvj\" (UID: \"51710c31-f7db-4aa6-bf61-ec68e8939d4c\") " pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:57:30.525174 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f79f\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-kube-api-access-8f79f\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-tls\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-bound-sa-token\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnp85\" (UniqueName: \"kubernetes.io/projected/5f5e4699-477d-4646-9fd0-bbc9fa9ff05c-kube-api-access-nnp85\") pod \"downloads-5bc67dcd46-6tngg\" (UID: \"5f5e4699-477d-4646-9fd0-bbc9fa9ff05c\") " pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-trusted-ca\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-installation-pull-secrets\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-certificates\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525420 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-image-registry-private-configuration\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.525840 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c01021aa-2079-4e70-93e6-ffa9945439e7-ca-trust-extracted\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.526010 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.525902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c01021aa-2079-4e70-93e6-ffa9945439e7-ca-trust-extracted\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.527000 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.526977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-trusted-ca\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.527125 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.526984 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-certificates\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.528983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.528960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:57:30.529350 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.529326 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-installation-pull-secrets\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.529459 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.529437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-registry-tls\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.529648 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.529627 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c01021aa-2079-4e70-93e6-ffa9945439e7-image-registry-private-configuration\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.536147 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.535263 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f79f\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-kube-api-access-8f79f\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.539758 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.539575 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:57:30.540158 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.540134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnp85\" (UniqueName: \"kubernetes.io/projected/5f5e4699-477d-4646-9fd0-bbc9fa9ff05c-kube-api-access-nnp85\") pod \"downloads-5bc67dcd46-6tngg\" (UID: \"5f5e4699-477d-4646-9fd0-bbc9fa9ff05c\") " pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:30.540535 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.540512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c01021aa-2079-4e70-93e6-ffa9945439e7-bound-sa-token\") pod \"image-registry-56cc77d8b7-xmfnx\" (UID: \"c01021aa-2079-4e70-93e6-ffa9945439e7\") " pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.550320 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.550298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72s8z\" (UniqueName: \"kubernetes.io/projected/c96fe36d-9d60-4150-bda2-522c86a4a067-kube-api-access-72s8z\") pod \"network-check-target-82dkg\" (UID: \"c96fe36d-9d60-4150-bda2-522c86a4a067\") " pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:57:30.615709 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.615672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:30.615915 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.615796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84kvj" Jul 17 13:57:30.625234 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.625194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:57:30.632202 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.632181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jk4g" Jul 17 13:57:30.678356 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.678328 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dzmb\"" Jul 17 13:57:30.686537 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.686512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:30.714265 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.714243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:57:30.722415 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.722393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:57:30.984427 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.984401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:30.998526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:30.998497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:31.129642 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129605 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.129822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129659 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.129822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129686 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.129822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129718 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.129822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129767 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.129822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129811 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j9zn\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.130098 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129844 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token\") pod \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\" (UID: \"ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395\") " Jul 17 13:57:31.130098 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.129991 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:57:31.130202 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.130120 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-ca-trust-extracted\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.130202 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.130172 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:57:31.130337 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.130300 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:57:31.132492 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.132397 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:57:31.132585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.132533 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn" (OuterVolumeSpecName: "kube-api-access-2j9zn") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "kube-api-access-2j9zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:57:31.132690 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.132665 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:57:31.132800 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.132734 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" (UID: "ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:57:31.171636 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.171601 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:57:31.178461 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.178435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.182630 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.182606 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 13:57:31.182767 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.182637 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 13:57:31.182914 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.182899 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 13:57:31.183031 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.183015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wgkvf\"" Jul 17 13:57:31.183270 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.183254 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 13:57:31.183347 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.183310 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 13:57:31.188540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.188513 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:57:31.230571 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230743 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230743 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230743 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf9xh\" (UniqueName: \"kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230868 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230868 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.230966 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230884 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j9zn\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-kube-api-access-2j9zn\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.230966 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230900 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-bound-sa-token\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.230966 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230935 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-image-registry-private-configuration\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.231108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230974 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-trusted-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.231108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.230987 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-installation-pull-secrets\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.231108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.231002 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-certificates\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:31.331931 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.331845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.331931 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.331909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332456 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.331938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332456 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf9xh\" (UniqueName: \"kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332456 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332456 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332869 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332925 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332741 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.332925 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.332750 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.334498 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.334478 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.334696 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.334672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.340311 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.340286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf9xh\" (UniqueName: \"kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh\") pod \"console-f975f566b-jv249\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.495060 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.494645 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:31.598982 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.598901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84kvj"] Jul 17 13:57:31.621842 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.621768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6tngg"] Jul 17 13:57:31.625184 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:31.625156 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5e4699_477d_4646_9fd0_bbc9fa9ff05c.slice/crio-34685fb1837491014c27ea6b17b409842e339d47b7868ab939cab56df296babf WatchSource:0}: Error finding container 34685fb1837491014c27ea6b17b409842e339d47b7868ab939cab56df296babf: Status 404 returned error can't find the container with id 34685fb1837491014c27ea6b17b409842e339d47b7868ab939cab56df296babf Jul 17 13:57:31.689209 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.689184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:57:31.691234 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:31.691209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc27c6f4_1525_433e_bacd_f58c256a3921.slice/crio-127db50378361680588045420fe0b75f093c10666e24662163154ec3c591c984 WatchSource:0}: Error finding container 127db50378361680588045420fe0b75f093c10666e24662163154ec3c591c984: Status 404 returned error can't find the container with id 127db50378361680588045420fe0b75f093c10666e24662163154ec3c591c984 Jul 17 13:57:31.850790 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.850763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jk4g"] Jul 17 13:57:31.853405 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:31.853376 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62068b8_28bf_425d_8fc7_8ce2d3d78eb3.slice/crio-bdb4a895d6e28cf297c34942d4a1f47732c9d60ba9ed8b876bc0aef5c0e3bd66 WatchSource:0}: Error finding container bdb4a895d6e28cf297c34942d4a1f47732c9d60ba9ed8b876bc0aef5c0e3bd66: Status 404 returned error can't find the container with id bdb4a895d6e28cf297c34942d4a1f47732c9d60ba9ed8b876bc0aef5c0e3bd66 Jul 17 13:57:31.853660 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.853641 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cc77d8b7-xmfnx"] Jul 17 13:57:31.856283 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.856249 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82dkg"] Jul 17 13:57:31.856808 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:31.856784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01021aa_2079_4e70_93e6_ffa9945439e7.slice/crio-e43cbd7bdd3c14539d3e39f3401b2fbe1b7eff568ac698bce5e56e3afcfabbc7 WatchSource:0}: Error finding container e43cbd7bdd3c14539d3e39f3401b2fbe1b7eff568ac698bce5e56e3afcfabbc7: Status 404 returned error can't find the container with id e43cbd7bdd3c14539d3e39f3401b2fbe1b7eff568ac698bce5e56e3afcfabbc7 Jul 17 13:57:31.860236 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:31.860213 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96fe36d_9d60_4150_bda2_522c86a4a067.slice/crio-70890acf53653e462c031310150bb05b25698c5e8eb0b0561fcd3298d9ba836b WatchSource:0}: Error finding container 70890acf53653e462c031310150bb05b25698c5e8eb0b0561fcd3298d9ba836b: Status 404 returned error can't find the container with id 70890acf53653e462c031310150bb05b25698c5e8eb0b0561fcd3298d9ba836b Jul 17 13:57:31.987993 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.987957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84kvj" event={"ID":"51710c31-f7db-4aa6-bf61-ec68e8939d4c","Type":"ContainerStarted","Data":"9422953cc3e37756b9fc4869e09efcc745e9847b00dc93f572bdf2f60b74a494"} Jul 17 13:57:31.989603 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.989563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" event={"ID":"c01021aa-2079-4e70-93e6-ffa9945439e7","Type":"ContainerStarted","Data":"409999d5359b6d44ec8fd777f34c097d1f71f437a2184795c29330d1d1c3977a"} Jul 17 13:57:31.989747 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.989614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" event={"ID":"c01021aa-2079-4e70-93e6-ffa9945439e7","Type":"ContainerStarted","Data":"e43cbd7bdd3c14539d3e39f3401b2fbe1b7eff568ac698bce5e56e3afcfabbc7"} Jul 17 13:57:31.989747 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.989639 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:31.990743 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.990716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82dkg" event={"ID":"c96fe36d-9d60-4150-bda2-522c86a4a067","Type":"ContainerStarted","Data":"70890acf53653e462c031310150bb05b25698c5e8eb0b0561fcd3298d9ba836b"} Jul 17 13:57:31.992022 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.992000 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975f566b-jv249" event={"ID":"bc27c6f4-1525-433e-bacd-f58c256a3921","Type":"ContainerStarted","Data":"127db50378361680588045420fe0b75f093c10666e24662163154ec3c591c984"} Jul 17 13:57:31.993129 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.993103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6tngg" event={"ID":"5f5e4699-477d-4646-9fd0-bbc9fa9ff05c","Type":"ContainerStarted","Data":"34685fb1837491014c27ea6b17b409842e339d47b7868ab939cab56df296babf"} Jul 17 13:57:31.994914 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.994893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4gl5" event={"ID":"d85cba3a-565f-48f2-9214-3e8a9c1e9d99","Type":"ContainerStarted","Data":"02805c2d1567dc6805ed5fb9a0cf6af9d47807ba889b99404b0f6809f65ae4c0"} Jul 17 13:57:31.996010 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.995991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jk4g" event={"ID":"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3","Type":"ContainerStarted","Data":"bdb4a895d6e28cf297c34942d4a1f47732c9d60ba9ed8b876bc0aef5c0e3bd66"} Jul 17 13:57:31.996109 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:31.996016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d766bb8f-wmv7f" Jul 17 13:57:32.008935 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.008894 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" podStartSLOduration=2.00887749 podStartE2EDuration="2.00887749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:32.008391375 +0000 UTC m=+67.884611865" watchObservedRunningTime="2026-07-17 13:57:32.00887749 +0000 UTC m=+67.885097945" Jul 17 13:57:32.034838 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.034804 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75d766bb8f-wmv7f"] Jul 17 13:57:32.039386 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.039356 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75d766bb8f-wmv7f"] Jul 17 13:57:32.143831 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.143741 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395-registry-tls\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:57:32.447269 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.446655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:32.469794 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.469699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43187e8d-dcd5-4371-bbb7-53187af7db74-metrics-tls\") pod \"dns-default-x2msr\" (UID: \"43187e8d-dcd5-4371-bbb7-53187af7db74\") " pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:32.608434 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.608211 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395" path="/var/lib/kubelet/pods/ddb7bb79-b36f-41c9-a2ec-6fdfbfb9f395/volumes" Jul 17 13:57:32.665481 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.665250 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf4sj\"" Jul 17 13:57:32.673894 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.673565 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:32.876800 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.875518 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2msr"] Jul 17 13:57:32.886365 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:32.886315 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43187e8d_dcd5_4371_bbb7_53187af7db74.slice/crio-6b66ebae735b4f57928c4a822bddeaa9bfd0c2fef0c3200c1983f668c1127c75 WatchSource:0}: Error finding container 6b66ebae735b4f57928c4a822bddeaa9bfd0c2fef0c3200c1983f668c1127c75: Status 404 returned error can't find the container with id 6b66ebae735b4f57928c4a822bddeaa9bfd0c2fef0c3200c1983f668c1127c75 Jul 17 13:57:32.951767 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.951728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:32.957735 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:32.957675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/daa27b01-9461-404d-aea5-030a2ef12ea5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-hp4k6\" (UID: \"daa27b01-9461-404d-aea5-030a2ef12ea5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:33.002510 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:33.002420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2msr" event={"ID":"43187e8d-dcd5-4371-bbb7-53187af7db74","Type":"ContainerStarted","Data":"6b66ebae735b4f57928c4a822bddeaa9bfd0c2fef0c3200c1983f668c1127c75"} Jul 17 13:57:33.206095 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:33.205996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xbqb4\"" Jul 17 13:57:33.213859 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:33.213581 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" Jul 17 13:57:33.728814 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:33.728782 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6"] Jul 17 13:57:33.837893 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:33.837807 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa27b01_9461_404d_aea5_030a2ef12ea5.slice/crio-5f8819c034422216021d15adebbf1d682f982754c2afa2f16444210e5d3ff667 WatchSource:0}: Error finding container 5f8819c034422216021d15adebbf1d682f982754c2afa2f16444210e5d3ff667: Status 404 returned error can't find the container with id 5f8819c034422216021d15adebbf1d682f982754c2afa2f16444210e5d3ff667 Jul 17 13:57:34.012519 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:34.012484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" event={"ID":"daa27b01-9461-404d-aea5-030a2ef12ea5","Type":"ContainerStarted","Data":"5f8819c034422216021d15adebbf1d682f982754c2afa2f16444210e5d3ff667"} Jul 17 13:57:35.020329 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:35.020292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jk4g" event={"ID":"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3","Type":"ContainerStarted","Data":"e04af094b905781e70c46d83e1a925514aa34ab63ecb3a03ed4085a92c0b1796"} Jul 17 13:57:35.020815 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:35.020367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jk4g" event={"ID":"c62068b8-28bf-425d-8fc7-8ce2d3d78eb3","Type":"ContainerStarted","Data":"15b8021911f983d411a63093a6fe91d5f678b30000db54278bfc5640ad9471a0"} Jul 17 13:57:35.041728 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:35.040529 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6jk4g" podStartSLOduration=68.03407527 podStartE2EDuration="1m10.04050782s" totalImagesPullingTime="2.00643255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:35.03919197 +0000 UTC m=+70.915412462" watchObservedRunningTime="2026-07-17 13:57:35.04050782 +0000 UTC m=+70.916728297" Jul 17 13:57:36.449501 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.449462 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx"] Jul 17 13:57:36.454754 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.454727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:36.457580 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.457546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 13:57:36.457798 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.457781 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vtxm9\"" Jul 17 13:57:36.464448 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.464390 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx"] Jul 17 13:57:36.588316 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.588270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2310df3-5481-4ad7-8acd-27748b205c10-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-28ddx\" (UID: \"d2310df3-5481-4ad7-8acd-27748b205c10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:36.689471 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.689429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2310df3-5481-4ad7-8acd-27748b205c10-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-28ddx\" (UID: \"d2310df3-5481-4ad7-8acd-27748b205c10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:36.693499 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.693468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2310df3-5481-4ad7-8acd-27748b205c10-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-28ddx\" (UID: \"d2310df3-5481-4ad7-8acd-27748b205c10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:36.768422 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:36.768343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:40.554942 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.554897 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:57:40.559257 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.559230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.573051 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.573022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:57:40.582235 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.582209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 13:57:40.622742 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.622742 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.622983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwgj\" (UniqueName: \"kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.622983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.622983 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.623166 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.622987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.623166 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.623030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723766 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwgj\" (UniqueName: \"kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.723957 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.723923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.724894 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.724564 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.724894 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.724595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.724894 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.724642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.725148 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.725105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.727566 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.727545 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.727674 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.727606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.734075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.734056 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwgj\" (UniqueName: \"kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj\") pod \"console-d8685ccd9-mvhld\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:40.872819 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:40.872786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:42.697202 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:42.697167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx"] Jul 17 13:57:42.762835 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:42.762793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:57:42.768467 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:42.768436 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a9a6c6_2a22_4e64_957c_11f792c19e51.slice/crio-afbb341353467623580367ba909fc6807e38b03c4867c9891bdd35959fcccd44 WatchSource:0}: Error finding container afbb341353467623580367ba909fc6807e38b03c4867c9891bdd35959fcccd44: Status 404 returned error can't find the container with id afbb341353467623580367ba909fc6807e38b03c4867c9891bdd35959fcccd44 Jul 17 13:57:43.054909 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.054809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4gl5" event={"ID":"d85cba3a-565f-48f2-9214-3e8a9c1e9d99","Type":"ContainerStarted","Data":"47ab70906bdfd53b4a969b5b046540b65f8e54ff6df4a74a66dff6285fbc11e9"} Jul 17 13:57:43.056367 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.056329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" event={"ID":"d2310df3-5481-4ad7-8acd-27748b205c10","Type":"ContainerStarted","Data":"8ebf1d7f34e43f51525633f5a6c4e922aa1b4d55df4bbc1a3b2b7bc27af3b434"} Jul 17 13:57:43.058111 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.058084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84kvj" event={"ID":"51710c31-f7db-4aa6-bf61-ec68e8939d4c","Type":"ContainerStarted","Data":"e0fc26f617e0db41e16af0ed901dfbb1aac7648239c00b122e7c80b355c3b494"} Jul 17 13:57:43.059752 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.059730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82dkg" event={"ID":"c96fe36d-9d60-4150-bda2-522c86a4a067","Type":"ContainerStarted","Data":"5dff57002b6d7dc0b61a111168445f3bdba679e68dc52b82282d3424a7f6894f"} Jul 17 13:57:43.059869 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.059831 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:57:43.061747 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.061716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2msr" event={"ID":"43187e8d-dcd5-4371-bbb7-53187af7db74","Type":"ContainerStarted","Data":"ad37da54b9a2d874c766e85339145ccf4f2db645d38363c13dc302637438eab5"} Jul 17 13:57:43.061866 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.061767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2msr" event={"ID":"43187e8d-dcd5-4371-bbb7-53187af7db74","Type":"ContainerStarted","Data":"b7dee1b5188463c1c71084275d2b98df0faa83e61734b1be57bce5332ddc28b3"} Jul 17 13:57:43.061866 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.061798 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:43.063435 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.063416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975f566b-jv249" event={"ID":"bc27c6f4-1525-433e-bacd-f58c256a3921","Type":"ContainerStarted","Data":"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb"} Jul 17 13:57:43.065100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.065072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" event={"ID":"daa27b01-9461-404d-aea5-030a2ef12ea5","Type":"ContainerStarted","Data":"af08585cb42dd4c5d6c6bd846ca6acc23107de202bee10841c623ed43cc0da25"} Jul 17 13:57:43.066756 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.066732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8685ccd9-mvhld" event={"ID":"d2a9a6c6-2a22-4e64-957c-11f792c19e51","Type":"ContainerStarted","Data":"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff"} Jul 17 13:57:43.066850 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.066775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8685ccd9-mvhld" event={"ID":"d2a9a6c6-2a22-4e64-957c-11f792c19e51","Type":"ContainerStarted","Data":"afbb341353467623580367ba909fc6807e38b03c4867c9891bdd35959fcccd44"} Jul 17 13:57:43.081585 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.081536 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h4gl5" podStartSLOduration=17.066823909 podStartE2EDuration="36.081521448s" totalImagesPullingTime="19.014697539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.080264698 +0000 UTC m=+78.956485176" watchObservedRunningTime="2026-07-17 13:57:43.081521448 +0000 UTC m=+78.957741925" Jul 17 13:57:43.106007 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.102020 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-84kvj" podStartSLOduration=67.215370102 podStartE2EDuration="1m18.10199287s" totalImagesPullingTime="10.886622768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.101008127 +0000 UTC m=+78.977228606" watchObservedRunningTime="2026-07-17 13:57:43.10199287 +0000 UTC m=+78.978213347" Jul 17 13:57:43.168099 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.168026 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f975f566b-jv249" podStartSLOduration=1.387562564 podStartE2EDuration="12.168010301s" totalImagesPullingTime="10.780447737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.131804531 +0000 UTC m=+79.008025007" watchObservedRunningTime="2026-07-17 13:57:43.168010301 +0000 UTC m=+79.044230759" Jul 17 13:57:43.168322 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.168302 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-82dkg" podStartSLOduration=67.548949703 podStartE2EDuration="1m18.16829429s" totalImagesPullingTime="10.619344587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.167440942 +0000 UTC m=+79.043661420" watchObservedRunningTime="2026-07-17 13:57:43.16829429 +0000 UTC m=+79.044514766" Jul 17 13:57:43.242321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.241577 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-hp4k6" podStartSLOduration=33.621487853 podStartE2EDuration="42.24156034s" totalImagesPullingTime="8.620072487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.240320865 +0000 UTC m=+79.116541343" watchObservedRunningTime="2026-07-17 13:57:43.24156034 +0000 UTC m=+79.117780816" Jul 17 13:57:43.242594 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:43.242544 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x2msr" podStartSLOduration=33.650887585 podStartE2EDuration="43.24252347s" totalImagesPullingTime="9.591635885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.21109948 +0000 UTC m=+79.087319960" watchObservedRunningTime="2026-07-17 13:57:43.24252347 +0000 UTC m=+79.118743958" Jul 17 13:57:44.073296 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:44.073198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" event={"ID":"d2310df3-5481-4ad7-8acd-27748b205c10","Type":"ContainerStarted","Data":"71429cf57897cf5a807e8ce7cd79f67f0c90da070e97f7088480b8c21193763a"} Jul 17 13:57:44.110421 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:44.110358 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" podStartSLOduration=7.02112012 podStartE2EDuration="8.110338345s" totalImagesPullingTime="1.089218225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.108916678 +0000 UTC m=+79.985137160" watchObservedRunningTime="2026-07-17 13:57:44.110338345 +0000 UTC m=+79.986558825" Jul 17 13:57:44.110604 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:44.110447 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d8685ccd9-mvhld" podStartSLOduration=4.110438893 podStartE2EDuration="4.110438893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:43.277321077 +0000 UTC m=+79.153541573" watchObservedRunningTime="2026-07-17 13:57:44.110438893 +0000 UTC m=+79.986659371" Jul 17 13:57:45.077075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.076894 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:45.083392 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.083358 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-28ddx" Jul 17 13:57:45.520591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.520552 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq"] Jul 17 13:57:45.526573 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.526546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.529976 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.529947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 17 13:57:45.531567 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.531543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 17 13:57:45.531683 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.531591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 13:57:45.531844 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.531822 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z5wvf\"" Jul 17 13:57:45.532257 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.532156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 13:57:45.532257 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.532220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 13:57:45.533625 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.533603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq"] Jul 17 13:57:45.678279 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.678239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8jt\" (UniqueName: \"kubernetes.io/projected/8de7d52e-be2d-47b1-9704-8bc645fa012c-kube-api-access-rc8jt\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.678462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.678309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.678462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.678334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de7d52e-be2d-47b1-9704-8bc645fa012c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.678462 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.678439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.779542 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.779453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.779542 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.779511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8jt\" (UniqueName: \"kubernetes.io/projected/8de7d52e-be2d-47b1-9704-8bc645fa012c-kube-api-access-rc8jt\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.779780 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.779559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.779780 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.779582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de7d52e-be2d-47b1-9704-8bc645fa012c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.780395 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.780367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8de7d52e-be2d-47b1-9704-8bc645fa012c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.782798 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.782776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.782891 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.782802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8de7d52e-be2d-47b1-9704-8bc645fa012c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.788766 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.788744 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8jt\" (UniqueName: \"kubernetes.io/projected/8de7d52e-be2d-47b1-9704-8bc645fa012c-kube-api-access-rc8jt\") pod \"prometheus-operator-5945b5cfd-zn5bq\" (UID: \"8de7d52e-be2d-47b1-9704-8bc645fa012c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:45.838755 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:45.838720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" Jul 17 13:57:50.873861 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:50.873823 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:50.874500 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:50.873921 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:50.879730 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:50.879702 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:51.104930 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:51.104902 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:57:51.156888 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:51.156797 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:57:51.326981 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:51.326950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq"] Jul 17 13:57:51.329565 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:51.329537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de7d52e_be2d_47b1_9704_8bc645fa012c.slice/crio-88965274d1f7e178dc22a6c5ac8b29aed4238df76e55d22f138ffdc70f8e97e6 WatchSource:0}: Error finding container 88965274d1f7e178dc22a6c5ac8b29aed4238df76e55d22f138ffdc70f8e97e6: Status 404 returned error can't find the container with id 88965274d1f7e178dc22a6c5ac8b29aed4238df76e55d22f138ffdc70f8e97e6 Jul 17 13:57:51.497609 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:51.497536 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f975f566b-jv249" Jul 17 13:57:52.106736 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.106694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" event={"ID":"8de7d52e-be2d-47b1-9704-8bc645fa012c","Type":"ContainerStarted","Data":"88965274d1f7e178dc22a6c5ac8b29aed4238df76e55d22f138ffdc70f8e97e6"} Jul 17 13:57:52.108467 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.108437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6tngg" event={"ID":"5f5e4699-477d-4646-9fd0-bbc9fa9ff05c","Type":"ContainerStarted","Data":"ee5fd514cddb8ed6f05a7dab30a1e4561d578d022dbaa5ca09488f2c0cd9adb4"} Jul 17 13:57:52.108848 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.108829 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:52.110394 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.110364 2562 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-6tngg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body= Jul 17 13:57:52.110489 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.110419 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-6tngg" podUID="5f5e4699-477d-4646-9fd0-bbc9fa9ff05c" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" Jul 17 13:57:52.129916 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:52.129860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6tngg" podStartSLOduration=2.021933697 podStartE2EDuration="22.129836741s" totalImagesPullingTime="20.107903044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:52.127579522 +0000 UTC m=+88.003800016" watchObservedRunningTime="2026-07-17 13:57:52.129836741 +0000 UTC m=+88.006057219" Jul 17 13:57:53.007628 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:53.007596 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56cc77d8b7-xmfnx" Jul 17 13:57:53.077290 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:53.077258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x2msr" Jul 17 13:57:53.128584 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:53.128559 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6tngg" Jul 17 13:57:54.120314 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:54.120271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" event={"ID":"8de7d52e-be2d-47b1-9704-8bc645fa012c","Type":"ContainerStarted","Data":"f2c34d68c5ad60c654346498c2734d1eb5a11b404813b1d73db92993b3492443"} Jul 17 13:57:54.120526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:54.120342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" event={"ID":"8de7d52e-be2d-47b1-9704-8bc645fa012c","Type":"ContainerStarted","Data":"dcf1ebfb73431a8b6b1e339966e2175e880cd71d2df2ccd0b895c753b695832f"} Jul 17 13:57:54.143352 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:54.143283 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zn5bq" podStartSLOduration=7.332943786 podStartE2EDuration="9.143261978s" totalImagesPullingTime="1.810318192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:54.141611262 +0000 UTC m=+90.017831741" watchObservedRunningTime="2026-07-17 13:57:54.143261978 +0000 UTC m=+90.019482455" Jul 17 13:57:55.904612 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.904576 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-82hlb"] Jul 17 13:57:55.943950 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.943913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rhb92"] Jul 17 13:57:55.944160 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.944115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:55.947727 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.947104 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 17 13:57:55.948349 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.948332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7jjcp\"" Jul 17 13:57:55.948650 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.948632 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 17 13:57:55.948837 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.948818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 17 13:57:55.961844 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.961825 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-82hlb"] Jul 17 13:57:55.961953 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.961941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:55.967808 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.964766 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 13:57:55.967808 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.965029 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 13:57:55.967808 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.965380 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dlxn\"" Jul 17 13:57:55.967808 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:55.965574 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 13:57:56.068815 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.068733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5de0d74e-3604-4563-948f-89837255d1d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.068815 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.068785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-wtmp\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.068877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.069108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.068943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-root\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.068972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfw4\" (UniqueName: \"kubernetes.io/projected/1a1df048-be6c-4543-806a-87bf41977a22-kube-api-access-mgfw4\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069108 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-textfile\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw2p4\" (UniqueName: \"kubernetes.io/projected/5de0d74e-3604-4563-948f-89837255d1d9-kube-api-access-rw2p4\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.069321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.069321 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.069591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-sys\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-metrics-client-ca\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.069591 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.069463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170112 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-sys\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170112 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-metrics-client-ca\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5de0d74e-3604-4563-948f-89837255d1d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-wtmp\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-root\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfw4\" (UniqueName: \"kubernetes.io/projected/1a1df048-be6c-4543-806a-87bf41977a22-kube-api-access-mgfw4\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-textfile\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw2p4\" (UniqueName: \"kubernetes.io/projected/5de0d74e-3604-4563-948f-89837255d1d9-kube-api-access-rw2p4\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.170705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.170609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-root\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.171143 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:56.171116 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 13:57:56.171302 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171274 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-sys\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.171395 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171370 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.171492 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:56.171467 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 17 13:57:56.171598 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:56.171511 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls podName:1a1df048-be6c-4543-806a-87bf41977a22 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:56.671489429 +0000 UTC m=+92.547709891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls") pod "node-exporter-rhb92" (UID: "1a1df048-be6c-4543-806a-87bf41977a22") : secret "node-exporter-tls" not found Jul 17 13:57:56.171598 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:56.171529 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls podName:5de0d74e-3604-4563-948f-89837255d1d9 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:56.671521056 +0000 UTC m=+92.547741513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-82hlb" (UID: "5de0d74e-3604-4563-948f-89837255d1d9") : secret "kube-state-metrics-tls" not found Jul 17 13:57:56.171598 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-textfile\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.171598 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5de0d74e-3604-4563-948f-89837255d1d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.171828 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-wtmp\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.171828 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-metrics-client-ca\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.171828 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.171717 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5de0d74e-3604-4563-948f-89837255d1d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.172094 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.172071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.173898 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.173870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.174062 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.174020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.188790 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.187298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw2p4\" (UniqueName: \"kubernetes.io/projected/5de0d74e-3604-4563-948f-89837255d1d9-kube-api-access-rw2p4\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.188909 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.188815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfw4\" (UniqueName: \"kubernetes.io/projected/1a1df048-be6c-4543-806a-87bf41977a22-kube-api-access-mgfw4\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.676493 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.676448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.676798 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.676518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.679508 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.679477 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5de0d74e-3604-4563-948f-89837255d1d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-82hlb\" (UID: \"5de0d74e-3604-4563-948f-89837255d1d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.682485 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.682459 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a1df048-be6c-4543-806a-87bf41977a22-node-exporter-tls\") pod \"node-exporter-rhb92\" (UID: \"1a1df048-be6c-4543-806a-87bf41977a22\") " pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.862209 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.862173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" Jul 17 13:57:56.877073 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.877031 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rhb92" Jul 17 13:57:56.935445 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:56.935388 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1df048_be6c_4543_806a_87bf41977a22.slice/crio-7a60b74196c8a7efbe4be4a57d39dd6b53f6eedcee7db20bb06c9e7a03da62e6 WatchSource:0}: Error finding container 7a60b74196c8a7efbe4be4a57d39dd6b53f6eedcee7db20bb06c9e7a03da62e6: Status 404 returned error can't find the container with id 7a60b74196c8a7efbe4be4a57d39dd6b53f6eedcee7db20bb06c9e7a03da62e6 Jul 17 13:57:56.978601 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.976926 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 13:57:56.991981 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.990917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.996309 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.996988 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.997244 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.997651 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.997862 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.998123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.998328 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.998584 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.998778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 13:57:56.999348 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:56.998971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g6vmt\"" Jul 17 13:57:57.009869 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.009830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 13:57:57.080555 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080735 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080735 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-web-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080735 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080735 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080928 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-out\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080928 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080928 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnrn4\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-kube-api-access-mnrn4\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.080928 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.081106 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-tls-assets\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.081106 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.081106 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.080992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-volume\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.081106 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.081023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.096053 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.095951 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-82hlb"] Jul 17 13:57:57.102375 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:57.102344 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de0d74e_3604_4563_948f_89837255d1d9.slice/crio-7c0387cecdd5eb1c63425546d03cbea0555395fe1e20446cddfe008a30cd058e WatchSource:0}: Error finding container 7c0387cecdd5eb1c63425546d03cbea0555395fe1e20446cddfe008a30cd058e: Status 404 returned error can't find the container with id 7c0387cecdd5eb1c63425546d03cbea0555395fe1e20446cddfe008a30cd058e Jul 17 13:57:57.136749 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.136709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" event={"ID":"5de0d74e-3604-4563-948f-89837255d1d9","Type":"ContainerStarted","Data":"7c0387cecdd5eb1c63425546d03cbea0555395fe1e20446cddfe008a30cd058e"} Jul 17 13:57:57.138075 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.138031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rhb92" event={"ID":"1a1df048-be6c-4543-806a-87bf41977a22","Type":"ContainerStarted","Data":"7a60b74196c8a7efbe4be4a57d39dd6b53f6eedcee7db20bb06c9e7a03da62e6"} Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-out\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnrn4\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-kube-api-access-mnrn4\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-tls-assets\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-volume\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-web-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.183433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.182981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.184158 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.183542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.184158 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:57:57.183673 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle podName:294b66c0-03c0-419f-b7ba-b5e112f5d232 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:57.68365167 +0000 UTC m=+93.559872129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "294b66c0-03c0-419f-b7ba-b5e112f5d232") : configmap references non-existent config key: ca-bundle.crt Jul 17 13:57:57.185224 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.185198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.187168 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.187142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.189475 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.189416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.190606 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.190561 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.190705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.190629 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.190705 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.190671 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-tls-assets\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.191209 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.191189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-web-config\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.191304 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.191285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-out\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.192728 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.192704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.193879 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.193854 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/294b66c0-03c0-419f-b7ba-b5e112f5d232-config-volume\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.195725 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.195701 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnrn4\" (UniqueName: \"kubernetes.io/projected/294b66c0-03c0-419f-b7ba-b5e112f5d232-kube-api-access-mnrn4\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.686958 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.686900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.687979 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.687949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/294b66c0-03c0-419f-b7ba-b5e112f5d232-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"294b66c0-03c0-419f-b7ba-b5e112f5d232\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:57.912142 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:57.912104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 13:57:58.264892 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:58.263507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 13:57:58.428852 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:57:58.428817 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294b66c0_03c0_419f_b7ba_b5e112f5d232.slice/crio-a4ed93b1eee08593564046d82b576fb3eb24ed7a2e47fa432cb702506b6617f9 WatchSource:0}: Error finding container a4ed93b1eee08593564046d82b576fb3eb24ed7a2e47fa432cb702506b6617f9: Status 404 returned error can't find the container with id a4ed93b1eee08593564046d82b576fb3eb24ed7a2e47fa432cb702506b6617f9 Jul 17 13:57:59.150967 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:59.150929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"a4ed93b1eee08593564046d82b576fb3eb24ed7a2e47fa432cb702506b6617f9"} Jul 17 13:57:59.152740 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:57:59.152707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rhb92" event={"ID":"1a1df048-be6c-4543-806a-87bf41977a22","Type":"ContainerStarted","Data":"45fb7aba40db8419424bb9978a18c46de5c0362a4e749c7b1da59a7974d2ff66"} Jul 17 13:58:00.159822 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.159783 2562 generic.go:356] "Generic (PLEG): container finished" podID="1a1df048-be6c-4543-806a-87bf41977a22" containerID="45fb7aba40db8419424bb9978a18c46de5c0362a4e749c7b1da59a7974d2ff66" exitCode=0 Jul 17 13:58:00.160329 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.160155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rhb92" event={"ID":"1a1df048-be6c-4543-806a-87bf41977a22","Type":"ContainerDied","Data":"45fb7aba40db8419424bb9978a18c46de5c0362a4e749c7b1da59a7974d2ff66"} Jul 17 13:58:00.163105 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.163076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" event={"ID":"5de0d74e-3604-4563-948f-89837255d1d9","Type":"ContainerStarted","Data":"5c0ff85d916981ac5b02a3c52c2683abd61ed85a72b284eb7f4d4b076fc3b30a"} Jul 17 13:58:00.163222 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.163130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" event={"ID":"5de0d74e-3604-4563-948f-89837255d1d9","Type":"ContainerStarted","Data":"4ca44fcd2e2024a8db7265f2f2a0fea9dbe5d232cb2fdd3631a091357b101695"} Jul 17 13:58:00.163222 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.163157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" event={"ID":"5de0d74e-3604-4563-948f-89837255d1d9","Type":"ContainerStarted","Data":"838b0c4138ca863962cc27bb39779f8893e51bfacc0891856c90b1998a4bcd78"} Jul 17 13:58:00.214465 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.214403 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-82hlb" podStartSLOduration=3.020119429 podStartE2EDuration="5.214380084s" totalImagesPullingTime="2.194260655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:00.213569462 +0000 UTC m=+96.089789942" watchObservedRunningTime="2026-07-17 13:58:00.214380084 +0000 UTC m=+96.090600562" Jul 17 13:58:00.334700 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.334650 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64ddb5bd89-xvqpr"] Jul 17 13:58:00.356391 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.356364 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64ddb5bd89-xvqpr"] Jul 17 13:58:00.356521 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.356500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.359721 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.359696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6gvcegf98ka43\"" Jul 17 13:58:00.359858 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.359746 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hkjzb\"" Jul 17 13:58:00.359993 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.359976 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 17 13:58:00.360194 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.360156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 13:58:00.360194 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.360173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 17 13:58:00.360831 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.360812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 17 13:58:00.416986 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.416925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdjc\" (UniqueName: \"kubernetes.io/projected/814a9c2f-76cf-4973-beac-5ec6717296d2-kube-api-access-hrdjc\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.416986 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.416977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-client-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.417211 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.417014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.417211 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.417069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-tls\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.417211 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.417132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/814a9c2f-76cf-4973-beac-5ec6717296d2-audit-log\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.417211 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.417191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-metrics-server-audit-profiles\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.417407 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.417225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-client-certs\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.517844 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.517814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdjc\" (UniqueName: \"kubernetes.io/projected/814a9c2f-76cf-4973-beac-5ec6717296d2-kube-api-access-hrdjc\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.517981 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.517870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-client-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518066 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518130 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-tls\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518130 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/814a9c2f-76cf-4973-beac-5ec6717296d2-audit-log\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518232 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-metrics-server-audit-profiles\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518290 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-client-certs\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.518593 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.518551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/814a9c2f-76cf-4973-beac-5ec6717296d2-audit-log\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.519152 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.519091 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.519518 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.519493 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/814a9c2f-76cf-4973-beac-5ec6717296d2-metrics-server-audit-profiles\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.521147 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.521124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-tls\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.521578 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.521555 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-client-ca-bundle\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.521987 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.521968 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/814a9c2f-76cf-4973-beac-5ec6717296d2-secret-metrics-server-client-certs\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.526902 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.526877 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdjc\" (UniqueName: \"kubernetes.io/projected/814a9c2f-76cf-4973-beac-5ec6717296d2-kube-api-access-hrdjc\") pod \"metrics-server-64ddb5bd89-xvqpr\" (UID: \"814a9c2f-76cf-4973-beac-5ec6717296d2\") " pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.682313 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.682224 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9"] Jul 17 13:58:00.695459 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.695427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:00.702330 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.702288 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:00.702493 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.702419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.706289 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.705980 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 17 13:58:00.706289 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.705993 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ftfqx\"" Jul 17 13:58:00.719399 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.719358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.719558 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.719458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmwhm\" (UniqueName: \"kubernetes.io/projected/c33c6405-40a9-4837-861b-e41116f2ebfb-kube-api-access-wmwhm\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.735261 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.735219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9"] Jul 17 13:58:00.735261 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.735265 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:00.735469 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.735367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.823001 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.822914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmwhm\" (UniqueName: \"kubernetes.io/projected/c33c6405-40a9-4837-861b-e41116f2ebfb-kube-api-access-wmwhm\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.823181 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.823028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.823244 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:58:00.823205 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 17 13:58:00.823301 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:58:00.823278 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert podName:c33c6405-40a9-4837-861b-e41116f2ebfb nodeName:}" failed. No retries permitted until 2026-07-17 13:58:01.323256324 +0000 UTC m=+97.199476800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-dpwv9" (UID: "c33c6405-40a9-4837-861b-e41116f2ebfb") : secret "monitoring-plugin-cert" not found Jul 17 13:58:00.835486 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.835458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmwhm\" (UniqueName: \"kubernetes.io/projected/c33c6405-40a9-4837-861b-e41116f2ebfb-kube-api-access-wmwhm\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:00.923869 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.923831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924187 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924303 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924303 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924303 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924479 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkmmg\" (UniqueName: \"kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.924479 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.924346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:00.934850 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:00.934786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64ddb5bd89-xvqpr"] Jul 17 13:58:00.939072 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:58:00.939024 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814a9c2f_76cf_4973_beac_5ec6717296d2.slice/crio-1e0405245440609b59868e9fcead47c9f7cca1316bb3823dd2bc529a8d47cb3d WatchSource:0}: Error finding container 1e0405245440609b59868e9fcead47c9f7cca1316bb3823dd2bc529a8d47cb3d: Status 404 returned error can't find the container with id 1e0405245440609b59868e9fcead47c9f7cca1316bb3823dd2bc529a8d47cb3d Jul 17 13:58:01.025693 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.025860 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.025860 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.025860 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.025860 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.025860 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkmmg\" (UniqueName: \"kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.026291 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.025874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.026679 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.026596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.027303 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.027267 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.027427 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.027352 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.027622 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.027597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.028669 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.028647 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.028879 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.028856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.037537 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.037510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkmmg\" (UniqueName: \"kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg\") pod \"console-75df4bfdc-2ltct\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.046464 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.046401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:01.171332 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.171066 2562 generic.go:356] "Generic (PLEG): container finished" podID="294b66c0-03c0-419f-b7ba-b5e112f5d232" containerID="f3dc3d2021c347c1984845963dd366724351f984822dc590fedf546d75623371" exitCode=0 Jul 17 13:58:01.171332 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.171197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerDied","Data":"f3dc3d2021c347c1984845963dd366724351f984822dc590fedf546d75623371"} Jul 17 13:58:01.174624 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.174523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rhb92" event={"ID":"1a1df048-be6c-4543-806a-87bf41977a22","Type":"ContainerStarted","Data":"d973f1a0d0f939ca00e4de908acd690fc86e67cba115146cedf67d8f38a3368a"} Jul 17 13:58:01.174624 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.174582 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rhb92" event={"ID":"1a1df048-be6c-4543-806a-87bf41977a22","Type":"ContainerStarted","Data":"8d332965f191682e40f2595ffdc210fec6de26440e103f634399900396fefcc9"} Jul 17 13:58:01.176971 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.176888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" event={"ID":"814a9c2f-76cf-4973-beac-5ec6717296d2","Type":"ContainerStarted","Data":"1e0405245440609b59868e9fcead47c9f7cca1316bb3823dd2bc529a8d47cb3d"} Jul 17 13:58:01.249693 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.249571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:01.251441 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.251396 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rhb92" podStartSLOduration=4.193236258 podStartE2EDuration="6.251380754s" totalImagesPullingTime="1.94312147s" totalInitContainerRuntime="115.023026ms" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:01.249374898 +0000 UTC m=+97.125595399" watchObservedRunningTime="2026-07-17 13:58:01.251380754 +0000 UTC m=+97.127601230" Jul 17 13:58:01.254918 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:58:01.254893 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656dfbd9_7b0d_4587_8caa_2b82e31cd9f0.slice/crio-3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048 WatchSource:0}: Error finding container 3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048: Status 404 returned error can't find the container with id 3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048 Jul 17 13:58:01.331368 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.331331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:01.333878 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.333851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c33c6405-40a9-4837-861b-e41116f2ebfb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dpwv9\" (UID: \"c33c6405-40a9-4837-861b-e41116f2ebfb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:01.615977 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.615941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:01.784594 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:01.784561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9"] Jul 17 13:58:01.788361 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:58:01.788335 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33c6405_40a9_4837_861b_e41116f2ebfb.slice/crio-61992ef1dc21a03f93420d35f7d7505a5284a8f989687a3923d8cf4256da7b45 WatchSource:0}: Error finding container 61992ef1dc21a03f93420d35f7d7505a5284a8f989687a3923d8cf4256da7b45: Status 404 returned error can't find the container with id 61992ef1dc21a03f93420d35f7d7505a5284a8f989687a3923d8cf4256da7b45 Jul 17 13:58:02.182992 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.182711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df4bfdc-2ltct" event={"ID":"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0","Type":"ContainerStarted","Data":"949c078628aa592f056dccab38799820467c263d68ff2ba4e9c9a46eef22bdac"} Jul 17 13:58:02.182992 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.182768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df4bfdc-2ltct" event={"ID":"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0","Type":"ContainerStarted","Data":"3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048"} Jul 17 13:58:02.184125 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.184093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" event={"ID":"c33c6405-40a9-4837-861b-e41116f2ebfb","Type":"ContainerStarted","Data":"61992ef1dc21a03f93420d35f7d7505a5284a8f989687a3923d8cf4256da7b45"} Jul 17 13:58:02.207412 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.207334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75df4bfdc-2ltct" podStartSLOduration=2.207285421 podStartE2EDuration="2.207285421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:02.206322012 +0000 UTC m=+98.082542493" watchObservedRunningTime="2026-07-17 13:58:02.207285421 +0000 UTC m=+98.083505895" Jul 17 13:58:02.244100 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.241316 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 13:58:02.260143 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.260107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.263422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.263739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-89qriebdpcg01\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.263971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hld6w\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.264151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.264179 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.264232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265096 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265079 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265139 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265261 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265445 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 13:58:02.266250 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.265940 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 13:58:02.271725 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.271696 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 13:58:02.274820 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.274643 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 13:58:02.277445 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.277419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 13:58:02.444376 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444376 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444376 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xlp\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-kube-api-access-v2xlp\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.444675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.444980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.445008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.445161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.445031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547283 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547283 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xlp\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-kube-api-access-v2xlp\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.547632 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.547597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.548403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.548214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.548403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.548253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.548403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.548283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.548403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.548341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.548403 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.548371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.550129 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.550063 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.552262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.551805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.552262 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.552109 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.552920 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.552895 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.553014 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.552940 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.555899 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.554205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.555899 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.554428 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9376853-c373-408b-9dbd-16c00cbb8984-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.555899 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.555008 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.555899 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.555532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.555899 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.555692 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.556344 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.556266 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.556887 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.556541 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.556887 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.556812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.557315 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.557025 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.559776 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.559364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.561571 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.561551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9376853-c373-408b-9dbd-16c00cbb8984-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.561962 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.561939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-config\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.564777 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.562829 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.564777 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.564721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xlp\" (UniqueName: \"kubernetes.io/projected/a9376853-c373-408b-9dbd-16c00cbb8984-kube-api-access-v2xlp\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.565824 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.565763 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9376853-c373-408b-9dbd-16c00cbb8984-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9376853-c373-408b-9dbd-16c00cbb8984\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:02.594624 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:02.594588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:03.698249 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:03.698160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 13:58:03.702213 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:58:03.702173 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9376853_c373_408b_9dbd_16c00cbb8984.slice/crio-98846345b24d3c2111a01cfc9829d1b1f4692bdd8520e908275d1f6dedc85d20 WatchSource:0}: Error finding container 98846345b24d3c2111a01cfc9829d1b1f4692bdd8520e908275d1f6dedc85d20: Status 404 returned error can't find the container with id 98846345b24d3c2111a01cfc9829d1b1f4692bdd8520e908275d1f6dedc85d20 Jul 17 13:58:04.197760 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.197726 2562 generic.go:356] "Generic (PLEG): container finished" podID="a9376853-c373-408b-9dbd-16c00cbb8984" containerID="38cf1cf065fe8e35bf5957834740f247796a1236e6e4c762edcefe1c94e8f702" exitCode=0 Jul 17 13:58:04.197940 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.197817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerDied","Data":"38cf1cf065fe8e35bf5957834740f247796a1236e6e4c762edcefe1c94e8f702"} Jul 17 13:58:04.197940 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.197885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"98846345b24d3c2111a01cfc9829d1b1f4692bdd8520e908275d1f6dedc85d20"} Jul 17 13:58:04.201293 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.201264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"70a3207bd987633fa078c6676548f1bc472725c1d3d73192ed57650491bdfd0a"} Jul 17 13:58:04.201401 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.201344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"63b1b418fe26f77d9d79c5ecfd22114a23fa0f65eda50ac73f0091bc8c22f5ca"} Jul 17 13:58:04.201401 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.201387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"5760887c89d09eee84ec912011d3615bf99499cf5a1bcc67e466ad0b391f74be"} Jul 17 13:58:04.201506 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.201424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"c6ea8b8169cda92eea19e97c20baa611e415985f1306fe19818d7a40e3ec860d"} Jul 17 13:58:04.202886 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.202864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" event={"ID":"814a9c2f-76cf-4973-beac-5ec6717296d2","Type":"ContainerStarted","Data":"7d38e09ca0af834495e85a33e7347149a2b872d95d6d5acfd2a637e674af9882"} Jul 17 13:58:04.251857 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:04.251789 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" podStartSLOduration=1.654854726 podStartE2EDuration="4.251769245s" totalImagesPullingTime="2.596914519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:04.250559582 +0000 UTC m=+100.126780071" watchObservedRunningTime="2026-07-17 13:58:04.251769245 +0000 UTC m=+100.127989725" Jul 17 13:58:05.208994 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:05.208931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" event={"ID":"c33c6405-40a9-4837-861b-e41116f2ebfb","Type":"ContainerStarted","Data":"a8cb89508337731562083d8c090856314855875d24111990e7510cb4c2b83f61"} Jul 17 13:58:05.209550 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:05.209527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:05.212829 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:05.212802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"79df48f51cd97dd318f69506398fe548d400d2c73c8eb47d495563fad531bc88"} Jul 17 13:58:05.214925 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:05.214904 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" Jul 17 13:58:05.232433 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:05.232376 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dpwv9" podStartSLOduration=1.971301422 podStartE2EDuration="5.232354562s" totalImagesPullingTime="3.26105314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:05.2311075 +0000 UTC m=+101.107327977" watchObservedRunningTime="2026-07-17 13:58:05.232354562 +0000 UTC m=+101.108575043" Jul 17 13:58:06.226422 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:06.226380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"294b66c0-03c0-419f-b7ba-b5e112f5d232","Type":"ContainerStarted","Data":"6262b3588ddab2ba543de3bc9ec012c84af3a9ac303935262e13da2c62015d7f"} Jul 17 13:58:06.255697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:06.255580 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.313258973 podStartE2EDuration="10.255557333s" totalImagesPullingTime="5.921842681s" totalInitContainerRuntime="20.455679ms" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:06.255296833 +0000 UTC m=+102.131517326" watchObservedRunningTime="2026-07-17 13:58:06.255557333 +0000 UTC m=+102.131777816" Jul 17 13:58:07.057505 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.057453 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:07.090440 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.090409 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:58:07.117399 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.116340 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:58:07.117399 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.116482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191055 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.190992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191228 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7vl4\" (UniqueName: \"kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.191436 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.191274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292285 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292285 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7vl4\" (UniqueName: \"kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.292853 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.292694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.293706 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.293435 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.293706 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.293565 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.293706 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.293673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.293864 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.293756 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.295551 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.295476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.296436 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.296409 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.302339 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.302313 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7vl4\" (UniqueName: \"kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4\") pod \"console-79864ff8c9-mvsdw\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.428691 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.428657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:07.952631 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:07.952593 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:58:07.955159 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:58:07.955133 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62628636_6eba_4ce7_b8cf_a8394ab8ddd8.slice/crio-d506546299d2555b5a93b617b8834c69a4511ea48f1cc1fe065fa6d2b38b8483 WatchSource:0}: Error finding container d506546299d2555b5a93b617b8834c69a4511ea48f1cc1fe065fa6d2b38b8483: Status 404 returned error can't find the container with id d506546299d2555b5a93b617b8834c69a4511ea48f1cc1fe065fa6d2b38b8483 Jul 17 13:58:08.238956 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:08.238917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79864ff8c9-mvsdw" event={"ID":"62628636-6eba-4ce7-b8cf-a8394ab8ddd8","Type":"ContainerStarted","Data":"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044"} Jul 17 13:58:08.239141 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:08.238985 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79864ff8c9-mvsdw" event={"ID":"62628636-6eba-4ce7-b8cf-a8394ab8ddd8","Type":"ContainerStarted","Data":"d506546299d2555b5a93b617b8834c69a4511ea48f1cc1fe065fa6d2b38b8483"} Jul 17 13:58:08.260693 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:08.260650 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79864ff8c9-mvsdw" podStartSLOduration=1.260631418 podStartE2EDuration="1.260631418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:08.258835215 +0000 UTC m=+104.135055693" watchObservedRunningTime="2026-07-17 13:58:08.260631418 +0000 UTC m=+104.136851894" Jul 17 13:58:09.246419 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:09.246385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"3b019f49b73854e86dd539f881091a1e7ade4813da3018cda3fa480478a43693"} Jul 17 13:58:09.246987 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:09.246470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"2c370204e6a8afef47d9155a43bb3af01f1c5353877281ebe5441401e655ca3e"} Jul 17 13:58:11.046809 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.046776 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:11.259971 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.259891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"971711bfb9c155ee5f61819a91e8be8230caf9d01a6d1c5c9520eb2a7cb631fa"} Jul 17 13:58:11.259971 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.259955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"c54c1dee9e3e2afbc05817f2c8e4dcbfa8b508ee8a7636ebee8cb15d486a74ba"} Jul 17 13:58:11.260164 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.259985 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"0ab6cce684ce15682d5f166ed8ab4c4985bd79fe7fae3b58e22240b18613de5f"} Jul 17 13:58:11.260164 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.260011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9376853-c373-408b-9dbd-16c00cbb8984","Type":"ContainerStarted","Data":"0ba67aaaf221fb81efcf39234273108773b57941fc1de91d5e78cffa2f77f8cf"} Jul 17 13:58:11.295227 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:11.295170 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.020886698 podStartE2EDuration="9.295152784s" totalImagesPullingTime="6.251410666s" totalInitContainerRuntime="22.85542ms" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:11.292200028 +0000 UTC m=+107.168420507" watchObservedRunningTime="2026-07-17 13:58:11.295152784 +0000 UTC m=+107.171373295" Jul 17 13:58:12.595681 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:12.595643 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:58:14.076814 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:14.076780 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-82dkg" Jul 17 13:58:16.177989 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.177948 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f975f566b-jv249" podUID="bc27c6f4-1525-433e-bacd-f58c256a3921" containerName="console" containerID="cri-o://74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb" gracePeriod=15 Jul 17 13:58:16.462897 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.462863 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975f566b-jv249" Jul 17 13:58:16.580087 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580029 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf9xh\" (UniqueName: \"kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580276 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580144 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580276 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580180 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580276 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580239 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580489 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580291 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580489 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580336 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert\") pod \"bc27c6f4-1525-433e-bacd-f58c256a3921\" (UID: \"bc27c6f4-1525-433e-bacd-f58c256a3921\") " Jul 17 13:58:16.580601 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580568 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:16.580749 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580725 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config" (OuterVolumeSpecName: "console-config") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:16.580954 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.580808 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:16.582670 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.582645 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:16.582756 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.582679 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh" (OuterVolumeSpecName: "kube-api-access-mf9xh") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "kube-api-access-mf9xh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:16.582756 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.582690 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc27c6f4-1525-433e-bacd-f58c256a3921" (UID: "bc27c6f4-1525-433e-bacd-f58c256a3921"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681617 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf9xh\" (UniqueName: \"kubernetes.io/projected/bc27c6f4-1525-433e-bacd-f58c256a3921-kube-api-access-mf9xh\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681646 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681655 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681666 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc27c6f4-1525-433e-bacd-f58c256a3921-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681675 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:16.681701 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:16.681684 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc27c6f4-1525-433e-bacd-f58c256a3921-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:17.286233 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.286194 2562 generic.go:356] "Generic (PLEG): container finished" podID="bc27c6f4-1525-433e-bacd-f58c256a3921" containerID="74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb" exitCode=0 Jul 17 13:58:17.286718 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.286263 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f975f566b-jv249" Jul 17 13:58:17.286718 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.286285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975f566b-jv249" event={"ID":"bc27c6f4-1525-433e-bacd-f58c256a3921","Type":"ContainerDied","Data":"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb"} Jul 17 13:58:17.286718 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.286372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f975f566b-jv249" event={"ID":"bc27c6f4-1525-433e-bacd-f58c256a3921","Type":"ContainerDied","Data":"127db50378361680588045420fe0b75f093c10666e24662163154ec3c591c984"} Jul 17 13:58:17.286718 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.286394 2562 scope.go:117] "RemoveContainer" containerID="74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb" Jul 17 13:58:17.295248 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.295235 2562 scope.go:117] "RemoveContainer" containerID="74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb" Jul 17 13:58:17.295507 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:58:17.295488 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb\": container with ID starting with 74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb not found: ID does not exist" containerID="74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb" Jul 17 13:58:17.295581 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.295516 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb"} err="failed to get container status \"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb\": rpc error: code = NotFound desc = could not find container \"74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb\": container with ID starting with 74033b57f752a77db3a8ac2a23e627a2d63a82bdf7405e6c8813625df2335beb not found: ID does not exist" Jul 17 13:58:17.308357 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.308330 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:58:17.310672 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.310641 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f975f566b-jv249"] Jul 17 13:58:17.429699 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.429661 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:17.429888 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.429738 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:17.434522 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:17.434500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:18.295659 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:18.295627 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:58:18.350289 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:18.350254 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:58:18.606114 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:18.606084 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc27c6f4-1525-433e-bacd-f58c256a3921" path="/var/lib/kubelet/pods/bc27c6f4-1525-433e-bacd-f58c256a3921/volumes" Jul 17 13:58:20.695872 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:20.695837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:20.696273 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:20.695896 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:32.088599 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.088535 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75df4bfdc-2ltct" podUID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" containerName="console" containerID="cri-o://949c078628aa592f056dccab38799820467c263d68ff2ba4e9c9a46eef22bdac" gracePeriod=15 Jul 17 13:58:32.350875 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.350843 2562 generic.go:356] "Generic (PLEG): container finished" podID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" containerID="949c078628aa592f056dccab38799820467c263d68ff2ba4e9c9a46eef22bdac" exitCode=0 Jul 17 13:58:32.351030 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.350912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df4bfdc-2ltct" event={"ID":"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0","Type":"ContainerDied","Data":"949c078628aa592f056dccab38799820467c263d68ff2ba4e9c9a46eef22bdac"} Jul 17 13:58:32.351030 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.350990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df4bfdc-2ltct" event={"ID":"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0","Type":"ContainerDied","Data":"3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048"} Jul 17 13:58:32.351030 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.351004 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3495b6bc00c24406f400a1993cfdcf32d729123fff64e3bd4e5260bf23e9a048" Jul 17 13:58:32.366393 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.366362 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:32.532626 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532590 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532821 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532634 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkmmg\" (UniqueName: \"kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532821 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532821 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532774 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532821 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532801 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532997 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532825 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.532997 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.532860 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert\") pod \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\" (UID: \"656dfbd9-7b0d-4587-8caa-2b82e31cd9f0\") " Jul 17 13:58:32.533431 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.533317 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config" (OuterVolumeSpecName: "console-config") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:32.533636 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.533612 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:32.533896 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.533675 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:32.534070 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.534054 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:32.535790 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.535753 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg" (OuterVolumeSpecName: "kube-api-access-bkmmg") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "kube-api-access-bkmmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:32.535933 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.535877 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:32.536066 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.535937 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" (UID: "656dfbd9-7b0d-4587-8caa-2b82e31cd9f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:32.634281 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634244 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634281 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634272 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634281 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634283 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634281 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634291 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634542 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634299 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634542 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634311 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkmmg\" (UniqueName: \"kubernetes.io/projected/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-kube-api-access-bkmmg\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:32.634542 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:32.634320 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:33.355179 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:33.355142 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df4bfdc-2ltct" Jul 17 13:58:33.371286 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:33.371257 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:33.373886 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:33.373864 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75df4bfdc-2ltct"] Jul 17 13:58:34.606811 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:34.606776 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" path="/var/lib/kubelet/pods/656dfbd9-7b0d-4587-8caa-2b82e31cd9f0/volumes" Jul 17 13:58:40.700910 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:40.700880 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:40.704811 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:40.704772 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64ddb5bd89-xvqpr" Jul 17 13:58:43.371814 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.371750 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d8685ccd9-mvhld" podUID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" containerName="console" containerID="cri-o://c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff" gracePeriod=15 Jul 17 13:58:43.654742 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.654717 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:58:43.730452 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730416 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730452 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730454 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730496 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730516 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730647 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730697 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730693 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhwgj\" (UniqueName: \"kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730894 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730759 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config\") pod \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\" (UID: \"d2a9a6c6-2a22-4e64-957c-11f792c19e51\") " Jul 17 13:58:43.730942 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730909 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:43.731057 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.730993 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:43.731057 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.731009 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config" (OuterVolumeSpecName: "console-config") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:43.731231 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.731080 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:43.733080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.733029 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:43.733080 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.733048 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj" (OuterVolumeSpecName: "kube-api-access-xhwgj") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "kube-api-access-xhwgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:43.733215 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.733132 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2a9a6c6-2a22-4e64-957c-11f792c19e51" (UID: "d2a9a6c6-2a22-4e64-957c-11f792c19e51"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:43.831576 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831533 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831576 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831569 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831576 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831580 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831816 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831592 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831816 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831606 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2a9a6c6-2a22-4e64-957c-11f792c19e51-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831816 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831616 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhwgj\" (UniqueName: \"kubernetes.io/projected/d2a9a6c6-2a22-4e64-957c-11f792c19e51-kube-api-access-xhwgj\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:43.831816 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:43.831628 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2a9a6c6-2a22-4e64-957c-11f792c19e51-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:58:44.405453 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.405413 2562 generic.go:356] "Generic (PLEG): container finished" podID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" containerID="c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff" exitCode=0 Jul 17 13:58:44.405871 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.405465 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8685ccd9-mvhld" Jul 17 13:58:44.405871 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.405497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8685ccd9-mvhld" event={"ID":"d2a9a6c6-2a22-4e64-957c-11f792c19e51","Type":"ContainerDied","Data":"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff"} Jul 17 13:58:44.405871 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.405562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8685ccd9-mvhld" event={"ID":"d2a9a6c6-2a22-4e64-957c-11f792c19e51","Type":"ContainerDied","Data":"afbb341353467623580367ba909fc6807e38b03c4867c9891bdd35959fcccd44"} Jul 17 13:58:44.405871 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.405582 2562 scope.go:117] "RemoveContainer" containerID="c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff" Jul 17 13:58:44.414973 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.414954 2562 scope.go:117] "RemoveContainer" containerID="c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff" Jul 17 13:58:44.415316 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:58:44.415292 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff\": container with ID starting with c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff not found: ID does not exist" containerID="c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff" Jul 17 13:58:44.415413 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.415323 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff"} err="failed to get container status \"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff\": rpc error: code = NotFound desc = could not find container \"c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff\": container with ID starting with c665f4e785402963dbd498ad77124a931ef03ea7cb29d3af7d8de4244edc9eff not found: ID does not exist" Jul 17 13:58:44.425750 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.425726 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:58:44.428633 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.428611 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d8685ccd9-mvhld"] Jul 17 13:58:44.605589 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:58:44.605553 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" path="/var/lib/kubelet/pods/d2a9a6c6-2a22-4e64-957c-11f792c19e51/volumes" Jul 17 13:59:02.595029 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:02.594993 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:59:02.615965 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:02.615941 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:59:03.507295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:03.507267 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 13:59:20.633078 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633029 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633342 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633353 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633367 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633373 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633385 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc27c6f4-1525-433e-bacd-f58c256a3921" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633390 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc27c6f4-1525-433e-bacd-f58c256a3921" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633464 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a9a6c6-2a22-4e64-957c-11f792c19e51" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633473 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc27c6f4-1525-433e-bacd-f58c256a3921" containerName="console" Jul 17 13:59:20.633540 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.633480 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="656dfbd9-7b0d-4587-8caa-2b82e31cd9f0" containerName="console" Jul 17 13:59:20.635260 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.635244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.650710 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.650687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 13:59:20.746795 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.746761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.746982 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.746820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.746982 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.746863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.746982 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.746881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.746982 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.746902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpl9\" (UniqueName: \"kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.747161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.747001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.747161 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.747063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848341 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpl9\" (UniqueName: \"kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.848523 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.848459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.849246 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.849219 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.849347 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.849253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.849347 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.849331 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.849495 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.849473 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.850829 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.850811 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.850920 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.850898 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.856676 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.856654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpl9\" (UniqueName: \"kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9\") pod \"console-6dccdf49dc-2t546\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:20.944897 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:20.944808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:21.075287 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:21.075264 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 13:59:21.077635 ip-10-0-139-104 kubenswrapper[2562]: W0717 13:59:21.077608 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4442040e_6da8_41e4_a4ed_4ef36b159e69.slice/crio-566a946dbf56b345e54a215af64735fcbd405b6101f990cca02e1c664a195c80 WatchSource:0}: Error finding container 566a946dbf56b345e54a215af64735fcbd405b6101f990cca02e1c664a195c80: Status 404 returned error can't find the container with id 566a946dbf56b345e54a215af64735fcbd405b6101f990cca02e1c664a195c80 Jul 17 13:59:21.567816 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:21.567782 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dccdf49dc-2t546" event={"ID":"4442040e-6da8-41e4-a4ed-4ef36b159e69","Type":"ContainerStarted","Data":"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4"} Jul 17 13:59:21.567994 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:21.567833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dccdf49dc-2t546" event={"ID":"4442040e-6da8-41e4-a4ed-4ef36b159e69","Type":"ContainerStarted","Data":"566a946dbf56b345e54a215af64735fcbd405b6101f990cca02e1c664a195c80"} Jul 17 13:59:21.590018 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:21.589968 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dccdf49dc-2t546" podStartSLOduration=1.589952134 podStartE2EDuration="1.589952134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:59:21.588558559 +0000 UTC m=+177.464779037" watchObservedRunningTime="2026-07-17 13:59:21.589952134 +0000 UTC m=+177.466172667" Jul 17 13:59:30.945201 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:30.945158 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:30.945675 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:30.945228 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:30.949987 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:30.949966 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:31.612382 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:31.612354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 13:59:31.675801 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:31.675753 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:59:56.697287 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:56.697223 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79864ff8c9-mvsdw" podUID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" containerName="console" containerID="cri-o://0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044" gracePeriod=15 Jul 17 13:59:56.944311 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:56.944289 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:59:57.061078 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.060963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061078 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061008 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7vl4\" (UniqueName: \"kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061084 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061114 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061185 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061212 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061295 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061240 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle\") pod \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\" (UID: \"62628636-6eba-4ce7-b8cf-a8394ab8ddd8\") " Jul 17 13:59:57.061644 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061603 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config" (OuterVolumeSpecName: "console-config") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:59:57.061644 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061614 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca" (OuterVolumeSpecName: "service-ca") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:59:57.061644 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061619 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:59:57.062001 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.061979 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:59:57.063419 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.063396 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:59:57.063526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.063436 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:59:57.063526 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.063471 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4" (OuterVolumeSpecName: "kube-api-access-l7vl4") pod "62628636-6eba-4ce7-b8cf-a8394ab8ddd8" (UID: "62628636-6eba-4ce7-b8cf-a8394ab8ddd8"). InnerVolumeSpecName "kube-api-access-l7vl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:59:57.162759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162705 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.162759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162751 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.162759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162761 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.162759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162770 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.162759 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162779 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.163094 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162787 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.163094 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.162795 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7vl4\" (UniqueName: \"kubernetes.io/projected/62628636-6eba-4ce7-b8cf-a8394ab8ddd8-kube-api-access-l7vl4\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 13:59:57.712182 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.712146 2562 generic.go:356] "Generic (PLEG): container finished" podID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" containerID="0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044" exitCode=0 Jul 17 13:59:57.712616 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.712194 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79864ff8c9-mvsdw" Jul 17 13:59:57.712616 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.712236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79864ff8c9-mvsdw" event={"ID":"62628636-6eba-4ce7-b8cf-a8394ab8ddd8","Type":"ContainerDied","Data":"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044"} Jul 17 13:59:57.712616 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.712293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79864ff8c9-mvsdw" event={"ID":"62628636-6eba-4ce7-b8cf-a8394ab8ddd8","Type":"ContainerDied","Data":"d506546299d2555b5a93b617b8834c69a4511ea48f1cc1fe065fa6d2b38b8483"} Jul 17 13:59:57.712616 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.712315 2562 scope.go:117] "RemoveContainer" containerID="0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044" Jul 17 13:59:57.721323 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.721306 2562 scope.go:117] "RemoveContainer" containerID="0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044" Jul 17 13:59:57.721571 ip-10-0-139-104 kubenswrapper[2562]: E0717 13:59:57.721554 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044\": container with ID starting with 0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044 not found: ID does not exist" containerID="0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044" Jul 17 13:59:57.721620 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.721579 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044"} err="failed to get container status \"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044\": rpc error: code = NotFound desc = could not find container \"0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044\": container with ID starting with 0053accaf103d8ba0c6a76696d97d49f19beeb183240148c9f01d737d95dc044 not found: ID does not exist" Jul 17 13:59:57.734294 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.734271 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:59:57.737471 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:57.737451 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79864ff8c9-mvsdw"] Jul 17 13:59:58.605221 ip-10-0-139-104 kubenswrapper[2562]: I0717 13:59:58.605190 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" path="/var/lib/kubelet/pods/62628636-6eba-4ce7-b8cf-a8394ab8ddd8/volumes" Jul 17 14:01:24.496783 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:01:24.496749 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 14:03:10.575142 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.575110 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659bd4655-xxmbp"] Jul 17 14:03:10.575593 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.575405 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" containerName="console" Jul 17 14:03:10.575593 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.575415 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" containerName="console" Jul 17 14:03:10.575593 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.575498 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62628636-6eba-4ce7-b8cf-a8394ab8ddd8" containerName="console" Jul 17 14:03:10.577553 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.577534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.591404 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.591379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659bd4655-xxmbp"] Jul 17 14:03:10.678899 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.678862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-oauth-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.678899 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.678894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-trusted-ca-bundle\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.679170 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.678924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v575r\" (UniqueName: \"kubernetes.io/projected/796a632e-2e9d-4c09-8bfa-a9e128fa6245-kube-api-access-v575r\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.679170 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.678954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-service-ca\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.679170 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.678984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-oauth-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.679170 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.679082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.679170 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.679102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780500 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-oauth-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-oauth-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-trusted-ca-bundle\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v575r\" (UniqueName: \"kubernetes.io/projected/796a632e-2e9d-4c09-8bfa-a9e128fa6245-kube-api-access-v575r\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.780916 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.780683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-service-ca\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.781285 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.781260 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-oauth-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.781440 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.781419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-service-ca\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.781549 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.781532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-trusted-ca-bundle\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.781591 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.781531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.783101 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.783074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-oauth-config\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.783194 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.783178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796a632e-2e9d-4c09-8bfa-a9e128fa6245-console-serving-cert\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.788707 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.788690 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v575r\" (UniqueName: \"kubernetes.io/projected/796a632e-2e9d-4c09-8bfa-a9e128fa6245-kube-api-access-v575r\") pod \"console-659bd4655-xxmbp\" (UID: \"796a632e-2e9d-4c09-8bfa-a9e128fa6245\") " pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:10.886782 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:10.886747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:11.025573 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:11.025549 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659bd4655-xxmbp"] Jul 17 14:03:11.028005 ip-10-0-139-104 kubenswrapper[2562]: W0717 14:03:11.027977 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796a632e_2e9d_4c09_8bfa_a9e128fa6245.slice/crio-9fcf2c67f46ba83da86641e48640d26ca2828eb838af885eb59333684bcd0742 WatchSource:0}: Error finding container 9fcf2c67f46ba83da86641e48640d26ca2828eb838af885eb59333684bcd0742: Status 404 returned error can't find the container with id 9fcf2c67f46ba83da86641e48640d26ca2828eb838af885eb59333684bcd0742 Jul 17 14:03:11.471374 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:11.471338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659bd4655-xxmbp" event={"ID":"796a632e-2e9d-4c09-8bfa-a9e128fa6245","Type":"ContainerStarted","Data":"48b2246f2db5cb7cc29e1b12b698d5a7c3d92c1f21db8aab96817905a5c93985"} Jul 17 14:03:11.471374 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:11.471385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659bd4655-xxmbp" event={"ID":"796a632e-2e9d-4c09-8bfa-a9e128fa6245","Type":"ContainerStarted","Data":"9fcf2c67f46ba83da86641e48640d26ca2828eb838af885eb59333684bcd0742"} Jul 17 14:03:11.490628 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:11.490576 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659bd4655-xxmbp" podStartSLOduration=1.490558756 podStartE2EDuration="1.490558756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:03:11.488975263 +0000 UTC m=+407.365195764" watchObservedRunningTime="2026-07-17 14:03:11.490558756 +0000 UTC m=+407.366779232" Jul 17 14:03:20.887292 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:20.887254 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:20.887695 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:20.887330 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:20.892158 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:20.892139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:21.513519 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:21.513488 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659bd4655-xxmbp" Jul 17 14:03:21.566800 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:21.566768 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 14:03:46.588368 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:46.588247 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dccdf49dc-2t546" podUID="4442040e-6da8-41e4-a4ed-4ef36b159e69" containerName="console" containerID="cri-o://63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4" gracePeriod=15 Jul 17 14:03:46.840129 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:46.840069 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 14:03:47.000495 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000437 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000701 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000514 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000701 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbpl9\" (UniqueName: \"kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000701 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000657 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000932 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000752 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000932 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000798 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000932 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000836 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert\") pod \"4442040e-6da8-41e4-a4ed-4ef36b159e69\" (UID: \"4442040e-6da8-41e4-a4ed-4ef36b159e69\") " Jul 17 14:03:47.000932 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000918 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca" (OuterVolumeSpecName: "service-ca") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:03:47.001160 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.000949 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config" (OuterVolumeSpecName: "console-config") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:03:47.001202 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.001175 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.001202 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.001194 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.001281 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.001202 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:03:47.001281 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.001235 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:03:47.002979 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.002951 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:03:47.003398 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.003366 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:03:47.003493 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.003394 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9" (OuterVolumeSpecName: "kube-api-access-fbpl9") pod "4442040e-6da8-41e4-a4ed-4ef36b159e69" (UID: "4442040e-6da8-41e4-a4ed-4ef36b159e69"). InnerVolumeSpecName "kube-api-access-fbpl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:03:47.102541 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.102510 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.102541 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.102545 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.102722 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.102555 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4442040e-6da8-41e4-a4ed-4ef36b159e69-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.102722 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.102565 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4442040e-6da8-41e4-a4ed-4ef36b159e69-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.102722 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.102573 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbpl9\" (UniqueName: \"kubernetes.io/projected/4442040e-6da8-41e4-a4ed-4ef36b159e69-kube-api-access-fbpl9\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:03:47.611804 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.611773 2562 generic.go:356] "Generic (PLEG): container finished" podID="4442040e-6da8-41e4-a4ed-4ef36b159e69" containerID="63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4" exitCode=0 Jul 17 14:03:47.612266 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.611820 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dccdf49dc-2t546" Jul 17 14:03:47.612266 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.611860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dccdf49dc-2t546" event={"ID":"4442040e-6da8-41e4-a4ed-4ef36b159e69","Type":"ContainerDied","Data":"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4"} Jul 17 14:03:47.612266 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.611923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dccdf49dc-2t546" event={"ID":"4442040e-6da8-41e4-a4ed-4ef36b159e69","Type":"ContainerDied","Data":"566a946dbf56b345e54a215af64735fcbd405b6101f990cca02e1c664a195c80"} Jul 17 14:03:47.612266 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.611953 2562 scope.go:117] "RemoveContainer" containerID="63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4" Jul 17 14:03:47.620277 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.620262 2562 scope.go:117] "RemoveContainer" containerID="63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4" Jul 17 14:03:47.620513 ip-10-0-139-104 kubenswrapper[2562]: E0717 14:03:47.620497 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4\": container with ID starting with 63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4 not found: ID does not exist" containerID="63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4" Jul 17 14:03:47.620558 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.620521 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4"} err="failed to get container status \"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4\": rpc error: code = NotFound desc = could not find container \"63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4\": container with ID starting with 63bf5da6a024ad116832ee70bab193fbc350d78d83f4c0f3f4827eb66c3036a4 not found: ID does not exist" Jul 17 14:03:47.633321 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.633297 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 14:03:47.638580 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:47.638558 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dccdf49dc-2t546"] Jul 17 14:03:48.605570 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:03:48.605540 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4442040e-6da8-41e4-a4ed-4ef36b159e69" path="/var/lib/kubelet/pods/4442040e-6da8-41e4-a4ed-4ef36b159e69/volumes" Jul 17 14:04:24.526240 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:04:24.526206 2562 scope.go:117] "RemoveContainer" containerID="949c078628aa592f056dccab38799820467c263d68ff2ba4e9c9a46eef22bdac" Jul 17 14:07:51.629832 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.629795 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-dwlpr"] Jul 17 14:07:51.630345 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.630117 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4442040e-6da8-41e4-a4ed-4ef36b159e69" containerName="console" Jul 17 14:07:51.630345 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.630129 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4442040e-6da8-41e4-a4ed-4ef36b159e69" containerName="console" Jul 17 14:07:51.630345 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.630183 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4442040e-6da8-41e4-a4ed-4ef36b159e69" containerName="console" Jul 17 14:07:51.633068 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.633054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:07:51.635778 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.635759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 17 14:07:51.635891 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.635760 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 14:07:51.636875 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.636856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 14:07:51.636961 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.636937 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-l6bvf\"" Jul 17 14:07:51.640243 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.640224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-dwlpr"] Jul 17 14:07:51.779262 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.779230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzhm\" (UniqueName: \"kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm\") pod \"feast-test-apply-dwlpr\" (UID: \"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31\") " pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:07:51.879927 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.879841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzhm\" (UniqueName: \"kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm\") pod \"feast-test-apply-dwlpr\" (UID: \"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31\") " pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:07:51.888891 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.888859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzhm\" (UniqueName: \"kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm\") pod \"feast-test-apply-dwlpr\" (UID: \"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31\") " pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:07:51.950672 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:51.950639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:07:52.083343 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:52.083323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-dwlpr"] Jul 17 14:07:52.085678 ip-10-0-139-104 kubenswrapper[2562]: W0717 14:07:52.085648 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2cfadbe_c73e_40b3_a13a_3e9d2b886f31.slice/crio-fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4 WatchSource:0}: Error finding container fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4: Status 404 returned error can't find the container with id fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4 Jul 17 14:07:52.087520 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:52.087504 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:07:52.563203 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:52.563170 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerStarted","Data":"fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4"} Jul 17 14:07:57.584774 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:07:57.584684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerStarted","Data":"2f759e2e8f92a8dfbad2d0b379d193c4e73a416dd1c30cd7ea86f0e22bb3606f"} Jul 17 14:08:03.610406 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:03.610378 2562 generic.go:356] "Generic (PLEG): container finished" podID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerID="2f759e2e8f92a8dfbad2d0b379d193c4e73a416dd1c30cd7ea86f0e22bb3606f" exitCode=0 Jul 17 14:08:03.610693 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:03.610413 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerDied","Data":"2f759e2e8f92a8dfbad2d0b379d193c4e73a416dd1c30cd7ea86f0e22bb3606f"} Jul 17 14:08:04.616195 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:04.616161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerStarted","Data":"57b497a6e79a46139664fbcb6776ff218cca335e9d49ed3cef89fe2b496edc8d"} Jul 17 14:08:04.632313 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:04.632266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-dwlpr" podStartSLOduration=2.190239757 podStartE2EDuration="13.632250872s" totalImagesPullingTime="5.194760636s" totalInitContainerRuntime="6.247250479s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:08:04.631425439 +0000 UTC m=+700.507645915" watchObservedRunningTime="2026-07-17 14:08:04.632250872 +0000 UTC m=+700.508471350" Jul 17 14:08:13.651559 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:13.651526 2562 generic.go:356] "Generic (PLEG): container finished" podID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerID="57b497a6e79a46139664fbcb6776ff218cca335e9d49ed3cef89fe2b496edc8d" exitCode=0 Jul 17 14:08:13.651559 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:13.651566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerDied","Data":"57b497a6e79a46139664fbcb6776ff218cca335e9d49ed3cef89fe2b496edc8d"} Jul 17 14:08:14.793711 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:14.793687 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:08:14.893549 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:14.893503 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gzhm\" (UniqueName: \"kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm\") pod \"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31\" (UID: \"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31\") " Jul 17 14:08:14.895746 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:14.895721 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm" (OuterVolumeSpecName: "kube-api-access-2gzhm") pod "b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" (UID: "b2cfadbe-c73e-40b3-a13a-3e9d2b886f31"). InnerVolumeSpecName "kube-api-access-2gzhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:08:14.994871 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:14.994747 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gzhm\" (UniqueName: \"kubernetes.io/projected/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31-kube-api-access-2gzhm\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jul 17 14:08:15.660531 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:15.660497 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-dwlpr" Jul 17 14:08:15.660700 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:15.660535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-dwlpr" event={"ID":"b2cfadbe-c73e-40b3-a13a-3e9d2b886f31","Type":"ContainerDied","Data":"fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4"} Jul 17 14:08:15.660700 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:15.660570 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe72426f41ae41f707364f4784bc87b881084d64b1b6f9ac9e5d884c7e99f1a4" Jul 17 14:08:15.850472 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:15.850443 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-dwlpr_b2cfadbe-c73e-40b3-a13a-3e9d2b886f31/feast-0/0.log" Jul 17 14:08:15.857449 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:15.857415 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-dwlpr_b2cfadbe-c73e-40b3-a13a-3e9d2b886f31/feast-1/0.log" Jul 17 14:08:52.109321 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:52.109280 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-dwlpr"] Jul 17 14:08:52.113561 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:52.113536 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-dwlpr"] Jul 17 14:08:52.605868 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:08:52.605832 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" path="/var/lib/kubelet/pods/b2cfadbe-c73e-40b3-a13a-3e9d2b886f31/volumes" Jul 17 14:14:24.601124 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:14:24.601091 2562 scope.go:117] "RemoveContainer" containerID="57b497a6e79a46139664fbcb6776ff218cca335e9d49ed3cef89fe2b496edc8d" Jul 17 14:14:24.615743 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:14:24.615720 2562 scope.go:117] "RemoveContainer" containerID="2f759e2e8f92a8dfbad2d0b379d193c4e73a416dd1c30cd7ea86f0e22bb3606f" Jul 17 14:25:02.944268 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:02.944173 2562 ???:1] "http: TLS handshake error from 10.0.138.92:34576: EOF" Jul 17 14:25:02.948867 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:02.948833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-84kvj_51710c31-f7db-4aa6-bf61-ec68e8939d4c/global-pull-secret-syncer/0.log" Jul 17 14:25:03.177224 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:03.177199 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zf46d_6c2a5820-9e12-4feb-805b-4ae688be1f06/konnectivity-agent/0.log" Jul 17 14:25:03.268468 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:03.268364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-104.ec2.internal_128787862a299fa7ae74f035b568dfb9/haproxy/0.log" Jul 17 14:25:06.182533 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.182508 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/alertmanager/0.log" Jul 17 14:25:06.226251 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.226220 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/config-reloader/0.log" Jul 17 14:25:06.263209 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.263187 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/kube-rbac-proxy-web/0.log" Jul 17 14:25:06.300893 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.300869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/kube-rbac-proxy/0.log" Jul 17 14:25:06.340998 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.340980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/kube-rbac-proxy-metric/0.log" Jul 17 14:25:06.392985 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.392953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/prom-label-proxy/0.log" Jul 17 14:25:06.438012 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.437948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_294b66c0-03c0-419f-b7ba-b5e112f5d232/init-config-reloader/0.log" Jul 17 14:25:06.537455 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.537422 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-82hlb_5de0d74e-3604-4563-948f-89837255d1d9/kube-state-metrics/0.log" Jul 17 14:25:06.574971 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.574947 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-82hlb_5de0d74e-3604-4563-948f-89837255d1d9/kube-rbac-proxy-main/0.log" Jul 17 14:25:06.627610 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.627590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-82hlb_5de0d74e-3604-4563-948f-89837255d1d9/kube-rbac-proxy-self/0.log" Jul 17 14:25:06.687987 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.687961 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64ddb5bd89-xvqpr_814a9c2f-76cf-4973-beac-5ec6717296d2/metrics-server/0.log" Jul 17 14:25:06.719014 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.718938 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-dpwv9_c33c6405-40a9-4837-861b-e41116f2ebfb/monitoring-plugin/0.log" Jul 17 14:25:06.944984 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.944953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rhb92_1a1df048-be6c-4543-806a-87bf41977a22/node-exporter/0.log" Jul 17 14:25:06.972546 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:06.972463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rhb92_1a1df048-be6c-4543-806a-87bf41977a22/kube-rbac-proxy/0.log" Jul 17 14:25:07.008166 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.008145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rhb92_1a1df048-be6c-4543-806a-87bf41977a22/init-textfile/0.log" Jul 17 14:25:07.173647 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.173623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/prometheus/0.log" Jul 17 14:25:07.234104 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.233985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/config-reloader/0.log" Jul 17 14:25:07.289667 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.289630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/thanos-sidecar/0.log" Jul 17 14:25:07.359187 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.359147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/kube-rbac-proxy-web/0.log" Jul 17 14:25:07.401875 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.401852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/kube-rbac-proxy/0.log" Jul 17 14:25:07.441944 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.441917 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/kube-rbac-proxy-thanos/0.log" Jul 17 14:25:07.474887 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.474845 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9376853-c373-408b-9dbd-16c00cbb8984/init-config-reloader/0.log" Jul 17 14:25:07.508318 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.508254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zn5bq_8de7d52e-be2d-47b1-9704-8bc645fa012c/prometheus-operator/0.log" Jul 17 14:25:07.539877 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.539854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zn5bq_8de7d52e-be2d-47b1-9704-8bc645fa012c/kube-rbac-proxy/0.log" Jul 17 14:25:07.583972 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:07.583954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-28ddx_d2310df3-5481-4ad7-8acd-27748b205c10/prometheus-operator-admission-webhook/0.log" Jul 17 14:25:09.305045 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:09.305021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-hp4k6_daa27b01-9461-404d-aea5-030a2ef12ea5/networking-console-plugin/0.log" Jul 17 14:25:10.233188 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.233158 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-659bd4655-xxmbp_796a632e-2e9d-4c09-8bfa-a9e128fa6245/console/0.log" Jul 17 14:25:10.288145 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.288125 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6tngg_5f5e4699-477d-4646-9fd0-bbc9fa9ff05c/download-server/0.log" Jul 17 14:25:10.524729 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.524643 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn"] Jul 17 14:25:10.525191 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.525136 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerName="feast-0" Jul 17 14:25:10.525191 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.525155 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerName="feast-0" Jul 17 14:25:10.525191 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.525173 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerName="feast-1" Jul 17 14:25:10.525191 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.525181 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerName="feast-1" Jul 17 14:25:10.525386 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.525266 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2cfadbe-c73e-40b3-a13a-3e9d2b886f31" containerName="feast-1" Jul 17 14:25:10.528427 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.528406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.540564 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.540547 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lzz5v\"/\"default-dockercfg-st7cx\"" Jul 17 14:25:10.540564 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.540556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"kube-root-ca.crt\"" Jul 17 14:25:10.540708 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.540555 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"openshift-service-ca.crt\"" Jul 17 14:25:10.552765 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.552737 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn"] Jul 17 14:25:10.571497 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.571468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-lib-modules\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.571625 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.571553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rfg5\" (UniqueName: \"kubernetes.io/projected/329b5f83-9219-4599-84c7-628556900e18-kube-api-access-4rfg5\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.571625 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.571589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-proc\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.571747 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.571645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-podres\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.571747 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.571696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-sys\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672146 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rfg5\" (UniqueName: \"kubernetes.io/projected/329b5f83-9219-4599-84c7-628556900e18-kube-api-access-4rfg5\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672146 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-proc\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-podres\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-sys\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672244 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-proc\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-lib-modules\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-sys\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672373 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-lib-modules\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.672583 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.672401 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/329b5f83-9219-4599-84c7-628556900e18-podres\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.681258 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.681227 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rfg5\" (UniqueName: \"kubernetes.io/projected/329b5f83-9219-4599-84c7-628556900e18-kube-api-access-4rfg5\") pod \"perf-node-gather-daemonset-585fn\" (UID: \"329b5f83-9219-4599-84c7-628556900e18\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.837663 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.837571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:10.981739 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:10.981716 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn"] Jul 17 14:25:10.984201 ip-10-0-139-104 kubenswrapper[2562]: W0717 14:25:10.984171 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod329b5f83_9219_4599_84c7_628556900e18.slice/crio-f164e82389aca20d164006f4255c98fe242395cab3a59b117f77a8529738af35 WatchSource:0}: Error finding container f164e82389aca20d164006f4255c98fe242395cab3a59b117f77a8529738af35: Status 404 returned error can't find the container with id f164e82389aca20d164006f4255c98fe242395cab3a59b117f77a8529738af35 Jul 17 14:25:11.608249 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.608217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" event={"ID":"329b5f83-9219-4599-84c7-628556900e18","Type":"ContainerStarted","Data":"cb47cacc12cd2891798d3b7d734cb7730c4c7d9e59bd9ff95b924dfd762946e7"} Jul 17 14:25:11.608634 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.608363 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:11.608634 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.608392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" event={"ID":"329b5f83-9219-4599-84c7-628556900e18","Type":"ContainerStarted","Data":"f164e82389aca20d164006f4255c98fe242395cab3a59b117f77a8529738af35"} Jul 17 14:25:11.633818 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.633775 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" podStartSLOduration=1.6337609720000001 podStartE2EDuration="1.633760972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:25:11.632559903 +0000 UTC m=+1727.508780381" watchObservedRunningTime="2026-07-17 14:25:11.633760972 +0000 UTC m=+1727.509981450" Jul 17 14:25:11.780477 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.780450 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2msr_43187e8d-dcd5-4371-bbb7-53187af7db74/dns/0.log" Jul 17 14:25:11.805015 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.804988 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2msr_43187e8d-dcd5-4371-bbb7-53187af7db74/kube-rbac-proxy/0.log" Jul 17 14:25:11.857312 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:11.857280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n9k2n_4a363112-2dc6-4994-8ad3-7a850746b984/dns-node-resolver/0.log" Jul 17 14:25:12.276021 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:12.275987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56cc77d8b7-xmfnx_c01021aa-2079-4e70-93e6-ffa9945439e7/registry/0.log" Jul 17 14:25:12.354640 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:12.354613 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrndt_6f05522c-a515-43f8-b0c2-890d769f0f80/node-ca/0.log" Jul 17 14:25:13.389760 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:13.389734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dqbrl_cbc68c11-7261-491d-bebb-0567d3bfda84/serve-healthcheck-canary/0.log" Jul 17 14:25:13.964308 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:13.964283 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4gl5_d85cba3a-565f-48f2-9214-3e8a9c1e9d99/kube-rbac-proxy/0.log" Jul 17 14:25:13.990186 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:13.990166 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4gl5_d85cba3a-565f-48f2-9214-3e8a9c1e9d99/exporter/0.log" Jul 17 14:25:14.016283 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:14.016260 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4gl5_d85cba3a-565f-48f2-9214-3e8a9c1e9d99/extractor/0.log" Jul 17 14:25:17.622325 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:17.622298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-585fn" Jul 17 14:25:19.682125 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.682098 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/kube-multus-additional-cni-plugins/0.log" Jul 17 14:25:19.720812 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.720791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/egress-router-binary-copy/0.log" Jul 17 14:25:19.761139 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.761114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/cni-plugins/0.log" Jul 17 14:25:19.803872 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.803848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/bond-cni-plugin/0.log" Jul 17 14:25:19.848235 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.848211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/routeoverride-cni/0.log" Jul 17 14:25:19.877612 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.877590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/whereabouts-cni-bincopy/0.log" Jul 17 14:25:19.906523 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:19.906478 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z429_ea6d1541-63bb-4819-a60b-7bc9dc381358/whereabouts-cni/0.log" Jul 17 14:25:20.436620 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:20.436597 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fzp6v_3494ee0d-3ff4-4ce0-9216-96617cd08296/kube-multus/0.log" Jul 17 14:25:20.539486 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:20.539412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6jk4g_c62068b8-28bf-425d-8fc7-8ce2d3d78eb3/network-metrics-daemon/0.log" Jul 17 14:25:20.567688 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:20.567663 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6jk4g_c62068b8-28bf-425d-8fc7-8ce2d3d78eb3/kube-rbac-proxy/0.log" Jul 17 14:25:21.835746 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:21.835718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/ovn-controller/0.log" Jul 17 14:25:21.902820 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:21.902789 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/ovn-acl-logging/0.log" Jul 17 14:25:21.942354 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:21.942281 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/kube-rbac-proxy-node/0.log" Jul 17 14:25:21.971411 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:21.971386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:25:22.000315 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:22.000296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/northd/0.log" Jul 17 14:25:22.026924 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:22.026902 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/nbdb/0.log" Jul 17 14:25:22.055944 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:22.055920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/sbdb/0.log" Jul 17 14:25:22.099922 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:22.099896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rb65w_a5aace4b-efce-4ec0-b6ac-d7ecd74efb45/ovnkube-controller/0.log" Jul 17 14:25:23.483316 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:23.483283 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-82dkg_c96fe36d-9d60-4150-bda2-522c86a4a067/network-check-target-container/0.log" Jul 17 14:25:24.574381 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:24.574347 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tg4kn_8610c315-7cf3-4a63-8db7-c6abdffe9d2a/iptables-alerter/0.log" Jul 17 14:25:25.339764 ip-10-0-139-104 kubenswrapper[2562]: I0717 14:25:25.339730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-d4sql_d24dbacc-014c-4015-aeda-5e4f82be7a14/tuned/0.log"