Jul 16 03:44:21.771579 ip-10-0-130-168 systemd[1]: Starting Kubernetes Kubelet... Jul 16 03:44:22.141127 ip-10-0-130-168 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 03:44:22.141127 ip-10-0-130-168 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 03:44:22.141127 ip-10-0-130-168 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 03:44:22.141127 ip-10-0-130-168 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 03:44:22.141127 ip-10-0-130-168 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 03:44:22.143779 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.143644 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 03:44:22.148441 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148425 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.148441 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148442 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148446 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148449 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148452 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148455 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148458 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148461 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148471 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148474 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148477 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148479 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148483 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148485 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148488 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148490 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148493 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148496 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148499 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148501 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148504 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.148508 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148507 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148510 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148513 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148516 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148519 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148522 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148524 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148527 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148529 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148533 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148538 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148541 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148545 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148548 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148551 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148554 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148557 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148559 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148563 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.148987 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148566 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148569 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148572 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148574 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148577 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148579 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148581 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148584 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148586 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148589 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148591 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148594 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148596 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148599 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148601 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148606 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148609 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148611 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148614 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148616 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.149735 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148619 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148622 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148624 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148626 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148629 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148632 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148634 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148637 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148640 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148642 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148646 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148649 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148652 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148654 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148657 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148660 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148662 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148665 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148667 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.150262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148670 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148672 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148675 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148677 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148680 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148683 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148685 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148689 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148693 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148695 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148700 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148703 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148706 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148708 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148712 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148714 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148717 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148719 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148722 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.150736 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.148724 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150596 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150608 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150612 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150615 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150618 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150621 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150624 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150627 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150630 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150632 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150635 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150637 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150640 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150644 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150649 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150651 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150655 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150658 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.151182 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150660 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150663 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150665 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150668 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150670 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150673 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150675 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150678 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150680 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150683 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150685 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150688 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150690 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150693 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150696 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150700 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150703 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150706 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150708 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150711 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.151798 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150714 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150717 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150719 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150722 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150724 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150727 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150729 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150732 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150734 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150737 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150740 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150743 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150746 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150750 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150754 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150757 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150760 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150763 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150765 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150768 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.152296 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150771 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150773 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150776 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150779 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150781 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150785 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150787 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150790 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150793 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150796 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150798 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150801 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150804 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150806 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150810 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150812 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150815 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150817 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150820 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150822 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.152787 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150824 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150827 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150830 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150832 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150835 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150847 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150851 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150853 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150856 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150859 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150861 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150864 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150866 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150869 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150871 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150876 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150879 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150881 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150884 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.153255 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150887 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.150890 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151287 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151293 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151296 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151299 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151301 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151304 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151307 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151309 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151312 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151315 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151317 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151320 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151322 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151325 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151328 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151348 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151352 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151355 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.153733 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151358 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151360 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151363 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151366 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151369 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151372 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151374 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151377 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151380 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151382 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151385 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151388 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151391 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151393 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151396 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151399 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151401 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151404 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151406 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151409 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.154214 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151411 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151414 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151416 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151418 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151421 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151423 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151426 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151429 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151431 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151435 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151438 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151442 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151444 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151447 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151449 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151452 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151454 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151457 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151459 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.154704 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151462 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151464 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151467 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151470 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151473 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151476 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151479 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151482 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151484 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151487 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151489 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151492 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151494 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151497 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151499 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151502 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151505 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151509 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151512 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151514 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.155156 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151517 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151520 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151523 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151525 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151530 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151534 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151537 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151540 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151543 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151545 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151549 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151552 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151554 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151556 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151559 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151562 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151564 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151567 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151570 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.155643 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151572 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151575 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.151578 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151645 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151652 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151658 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151664 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151668 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151671 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151675 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151679 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151682 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151685 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151688 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151691 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151694 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151697 2583 flags.go:64] FLAG: --cgroup-root="" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151700 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151703 2583 flags.go:64] FLAG: --client-ca-file="" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151707 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151709 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151713 2583 flags.go:64] FLAG: --cluster-domain="" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151716 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 03:44:22.156084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151719 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151722 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151725 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151729 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151732 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151734 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151738 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151741 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151744 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151747 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151750 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151753 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151757 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151760 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151763 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151766 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151768 2583 flags.go:64] FLAG: --enable-server="true" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.151771 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152213 2583 flags.go:64] FLAG: --event-burst="100" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152217 2583 flags.go:64] FLAG: --event-qps="50" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152220 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152223 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152227 2583 flags.go:64] FLAG: --eviction-hard="" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152231 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 03:44:22.156667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152234 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152236 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152242 2583 flags.go:64] FLAG: --eviction-soft="" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152245 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152248 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152252 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152255 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152258 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152261 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152264 2583 flags.go:64] FLAG: --feature-gates="" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152267 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152270 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152274 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152277 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152280 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152283 2583 flags.go:64] FLAG: --help="false" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152286 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152289 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152292 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152295 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152298 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152302 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152305 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 03:44:22.157219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152308 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152311 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152314 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152317 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152320 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152322 2583 flags.go:64] FLAG: --kube-reserved="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152325 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152343 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152348 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152351 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152354 2583 flags.go:64] FLAG: --lock-file="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152358 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152360 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152364 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152369 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152379 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152382 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152385 2583 flags.go:64] FLAG: --logging-format="text" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152388 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152391 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152394 2583 flags.go:64] FLAG: --manifest-url="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152397 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152402 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152405 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152415 2583 flags.go:64] FLAG: --max-pods="110" Jul 16 03:44:22.157810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152418 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152420 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152423 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152426 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152429 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152432 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152435 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152443 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152446 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152448 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152452 2583 flags.go:64] FLAG: --pod-cidr="" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152454 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152460 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152463 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152466 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152469 2583 flags.go:64] FLAG: --port="10250" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152472 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152475 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c10bb561c0d55239" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152478 2583 flags.go:64] FLAG: --qos-reserved="" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152484 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152487 2583 flags.go:64] FLAG: --register-node="true" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152490 2583 flags.go:64] FLAG: --register-with-taints="" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152495 2583 flags.go:64] FLAG: --registry-burst="10" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152498 2583 flags.go:64] FLAG: --registry-qps="5" Jul 16 03:44:22.158428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152501 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152504 2583 flags.go:64] FLAG: --reserved-memory="" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152508 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152511 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152514 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152517 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152520 2583 flags.go:64] FLAG: --runonce="false" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152522 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152526 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152529 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152531 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152534 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152537 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152540 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152543 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152546 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152549 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152552 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152554 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152557 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152560 2583 flags.go:64] FLAG: --system-cgroups="" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152563 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152568 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152570 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152573 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 03:44:22.159002 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152577 2583 flags.go:64] FLAG: --tls-min-version="" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152580 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152584 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152587 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152590 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152594 2583 flags.go:64] FLAG: --v="2" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152599 2583 flags.go:64] FLAG: --version="false" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152603 2583 flags.go:64] FLAG: --vmodule="" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152607 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.152610 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152726 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152730 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152734 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152737 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152740 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152743 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152745 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152748 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152750 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152753 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152755 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152758 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.159606 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152761 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152763 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152766 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152768 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152770 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152773 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152776 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152778 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152780 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152783 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152786 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152788 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152793 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152796 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152799 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152802 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152805 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152808 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152811 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.160160 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152813 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152816 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152818 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152821 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152825 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152828 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152831 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152834 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152837 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152840 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152842 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152845 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152848 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152850 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152853 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152856 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152858 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152861 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152863 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152866 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.160637 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152868 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152871 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152873 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152875 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152878 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152882 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152884 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152887 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152890 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152893 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152895 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152899 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152908 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152912 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152915 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152918 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152920 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152923 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152925 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.161113 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152928 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152931 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152933 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152936 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152938 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152941 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152943 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152946 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152948 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152951 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152953 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152956 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152958 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152960 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152963 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152965 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152968 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152970 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152974 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152977 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.161594 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152979 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152983 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152986 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152990 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152993 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.152996 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.153000 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.153003 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.153006 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.153970 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.160136 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.160151 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.160832 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.160840 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 03:44:22.162078 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160894 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160899 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160903 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160906 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160909 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160912 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160915 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160918 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160921 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160925 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160927 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160930 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160933 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160936 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160940 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160944 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160947 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160950 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160953 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160956 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.162436 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160958 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160961 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160963 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160966 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160969 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160973 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160975 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160978 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160982 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160986 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160990 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160993 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160996 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.160998 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161001 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161004 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161006 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161009 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161013 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.162895 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161016 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161019 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161021 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161024 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161027 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161029 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161032 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161034 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161037 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161039 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161042 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161045 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161047 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161050 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161052 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161055 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161058 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161060 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161063 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161066 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.163445 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161069 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161072 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161075 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161078 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161080 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161083 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161086 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161089 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161091 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161094 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161096 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161099 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161101 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161104 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161106 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161109 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161112 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161114 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161117 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161119 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.163924 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161122 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161125 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161128 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161130 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161133 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161135 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161138 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161140 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161143 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161145 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161148 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161151 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161153 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161156 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161159 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161162 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161164 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161167 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161169 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.164401 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161172 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.161177 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161286 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161290 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161294 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161296 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161299 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161302 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161305 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161307 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161310 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161312 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161315 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161317 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161320 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 03:44:22.164852 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161323 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161325 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161327 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161342 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161346 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161349 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161352 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161355 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161358 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161360 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161364 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161367 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161370 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161374 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161378 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161381 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161384 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161387 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161389 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 03:44:22.165222 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161392 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161395 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161397 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161400 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161402 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161405 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161408 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161410 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161413 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161415 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161418 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161420 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161423 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161426 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161428 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161431 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161433 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161436 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161439 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 03:44:22.165691 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161441 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161444 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161446 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161449 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161451 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161454 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161458 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161460 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161463 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161465 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161468 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161470 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161473 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161475 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161478 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161480 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161483 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161485 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161487 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161490 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 03:44:22.166134 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161492 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161495 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161497 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161500 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161503 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161505 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161508 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161510 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161513 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161515 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161518 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161528 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161531 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161534 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161536 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161539 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161542 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161544 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161548 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161550 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 03:44:22.166670 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161553 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161555 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161559 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161562 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161566 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161568 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161570 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:22.161573 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.161578 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.161677 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.163556 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.164890 2583 server.go:1019] "Starting client certificate rotation" Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.164992 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 03:44:22.167159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.165023 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 03:44:22.167493 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.167083 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 03:44:22.168221 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.168202 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 03:44:22.178824 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.178804 2583 log.go:25] "Validated CRI v1 runtime API" Jul 16 03:44:22.183344 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.183308 2583 log.go:25] "Validated CRI v1 image API" Jul 16 03:44:22.184217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.184202 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 03:44:22.186439 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.186421 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9b932443-2db8-4c76-a456-efc3eebc2b2b:/dev/nvme0n1p3 df8bed33-a62b-4314-b8db-46a06b72ba4e:/dev/nvme0n1p4] Jul 16 03:44:22.186503 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.186437 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 03:44:22.194005 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.193891 2583 manager.go:216] Machine: {Timestamp:2026-07-16 03:44:22.192607966 +0000 UTC m=+0.312153386 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100925 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da4ac0662af4064d1d208681c7072 SystemUUID:ec2da4ac-0662-af40-64d1-d208681c7072 BootID:a5199f86-0bd7-453b-856a-271b74710299 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:8e:0d:ee:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:8e:0d:ee:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:3b:63:df:cf:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 03:44:22.194005 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.193997 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 03:44:22.194140 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.194076 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 03:44:22.195874 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.195857 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 03:44:22.196905 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.196883 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 03:44:22.197032 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.196908 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 03:44:22.198256 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.198245 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 03:44:22.198291 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.198260 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 03:44:22.198291 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.198267 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 03:44:22.198990 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.198979 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 03:44:22.200286 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.200276 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 03:44:22.204142 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204132 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 16 03:44:22.204247 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204239 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 03:44:22.204276 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204268 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 16 03:44:22.204309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204278 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 03:44:22.204309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204290 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 03:44:22.204309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204299 2583 kubelet.go:398] "Adding apiserver pod source" Jul 16 03:44:22.204309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204308 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 03:44:22.204695 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204679 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 03:44:22.204758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.204701 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 03:44:22.206717 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.206700 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 03:44:22.208328 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208311 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 03:44:22.208429 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208364 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 03:44:22.208558 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208545 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 03:44:22.208615 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208565 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 03:44:22.208615 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208574 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 03:44:22.208615 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208582 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 03:44:22.208615 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208594 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 03:44:22.208615 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.208604 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 03:44:22.209138 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209128 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 03:44:22.209188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209140 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 03:44:22.209188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209151 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 03:44:22.209188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209161 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 03:44:22.209188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209174 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 03:44:22.209188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209186 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 03:44:22.209980 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209968 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 03:44:22.210066 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.209982 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 03:44:22.213181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.213165 2583 server.go:1268] "Started kubelet" Jul 16 03:44:22.213271 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.213247 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 03:44:22.213473 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.213410 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 03:44:22.213552 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.213505 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 03:44:22.214144 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.214117 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 03:44:22.214133 ip-10-0-130-168 systemd[1]: Started Kubernetes Kubelet. Jul 16 03:44:22.214366 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.214140 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 03:44:22.214366 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.214214 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 03:44:22.214574 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.214552 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 03:44:22.215704 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.215686 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 16 03:44:22.216655 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.216638 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s6f46" Jul 16 03:44:22.218507 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.218477 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 03:44:22.218952 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.218023 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-168.ec2.internal.18c2a84f98e49722 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-168.ec2.internal,UID:ip-10-0-130-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-168.ec2.internal,},FirstTimestamp:2026-07-16 03:44:22.21313821 +0000 UTC m=+0.332683630,LastTimestamp:2026-07-16 03:44:22.21313821 +0000 UTC m=+0.332683630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-168.ec2.internal,}" Jul 16 03:44:22.220463 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.220437 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 03:44:22.220463 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.220441 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 03:44:22.220595 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.220564 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.221090 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221074 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 03:44:22.221090 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221076 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 03:44:22.221230 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221101 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 03:44:22.221230 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221210 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 16 03:44:22.221230 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221220 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 16 03:44:22.221392 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221378 2583 factory.go:55] Registering systemd factory Jul 16 03:44:22.221438 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221396 2583 factory.go:223] Registration of the systemd container factory successfully Jul 16 03:44:22.221605 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221589 2583 factory.go:153] Registering CRI-O factory Jul 16 03:44:22.221673 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221607 2583 factory.go:223] Registration of the crio container factory successfully Jul 16 03:44:22.221673 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221647 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 03:44:22.221673 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221668 2583 factory.go:103] Registering Raw factory Jul 16 03:44:22.221804 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.221683 2583 manager.go:1196] Started watching for new ooms in manager Jul 16 03:44:22.222224 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.222209 2583 manager.go:349] Starting recovery of all containers Jul 16 03:44:22.224559 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.224535 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s6f46" Jul 16 03:44:22.229976 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.229944 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 03:44:22.229976 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.229961 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 03:44:22.234385 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.234228 2583 manager.go:354] Recovery completed Jul 16 03:44:22.238634 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.238623 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.240380 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240363 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.240465 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240392 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.240465 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240407 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.240953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240939 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 03:44:22.240953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240953 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 03:44:22.241046 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240943 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.241046 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.240972 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 16 03:44:22.241612 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.241594 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.241687 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.241625 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.241687 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.241639 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.243012 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.242994 2583 policy_none.go:49] "None policy: Start" Jul 16 03:44:22.243012 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.243010 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 03:44:22.243103 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.243021 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 03:44:22.244883 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.244872 2583 policy_none.go:47] "Start" Jul 16 03:44:22.277975 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.277953 2583 manager.go:337] "Starting Device Plugin manager" Jul 16 03:44:22.278075 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.277990 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 03:44:22.278075 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278004 2583 server.go:87] "Starting device plugin registration server" Jul 16 03:44:22.278258 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278244 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 03:44:22.278314 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278260 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 03:44:22.278396 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278361 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 03:44:22.278472 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278458 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 03:44:22.278472 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.278472 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 03:44:22.279028 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.278993 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 03:44:22.279153 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.279047 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.322095 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.322059 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 03:44:22.331901 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.323517 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 03:44:22.331901 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.323553 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 03:44:22.331901 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.323574 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 03:44:22.331901 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.323613 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 03:44:22.331901 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.325794 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:22.380405 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.380369 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.381247 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.381232 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.381321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.381259 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.381321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.381271 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.381321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.381293 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.389650 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.389627 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.389744 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.389654 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-168.ec2.internal\": node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.402749 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.402697 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.424503 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.424481 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal"] Jul 16 03:44:22.424569 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.424536 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.426303 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.426288 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.426386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.426316 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.426386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.426326 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.428527 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.428515 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.428634 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.428620 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.428673 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.428650 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.429218 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429198 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.429307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429215 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.429307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429230 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.429307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429239 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.429307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429246 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.429307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.429249 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.431649 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.431628 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.431705 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.431662 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 03:44:22.432294 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.432278 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientMemory" Jul 16 03:44:22.432393 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.432306 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 03:44:22.432393 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.432320 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeHasSufficientPID" Jul 16 03:44:22.461129 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.461104 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-168.ec2.internal\" not found" node="ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.465759 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.465740 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-168.ec2.internal\" not found" node="ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.503496 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.503478 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.523197 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.523175 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c5b7472850cd0aeba254c850e4f4352-config\") pod \"kube-apiserver-proxy-ip-10-0-130-168.ec2.internal\" (UID: \"8c5b7472850cd0aeba254c850e4f4352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.523260 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.523202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.523260 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.523230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.603762 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.603724 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.623452 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.623515 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.623515 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c5b7472850cd0aeba254c850e4f4352-config\") pod \"kube-apiserver-proxy-ip-10-0-130-168.ec2.internal\" (UID: \"8c5b7472850cd0aeba254c850e4f4352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.623515 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623503 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c5b7472850cd0aeba254c850e4f4352-config\") pod \"kube-apiserver-proxy-ip-10-0-130-168.ec2.internal\" (UID: \"8c5b7472850cd0aeba254c850e4f4352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.623621 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623533 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.623621 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.623541 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd53d53b99b482f488ac1acbac81aed8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal\" (UID: \"dd53d53b99b482f488ac1acbac81aed8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.706020 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.705944 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.764809 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.764782 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.768434 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:22.768416 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:22.806999 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.806963 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:22.913524 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:22.913483 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.013779 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.013696 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.046675 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.046650 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:23.116698 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.116665 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.165544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.165514 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 03:44:23.166155 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.165677 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 03:44:23.166155 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.165694 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 03:44:23.217153 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.217129 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.230642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.230607 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 03:39:22 +0000 UTC" deadline="2028-03-16 11:40:39.702002969 +0000 UTC" Jul 16 03:44:23.230642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.230637 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14623h56m16.47137022s" Jul 16 03:44:23.266622 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.266562 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:23.317506 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.317467 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.370770 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:23.370735 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5b7472850cd0aeba254c850e4f4352.slice/crio-c1ef48874c93e5cff61f4d8de383ad5bfaf97f25491629f53ec16d93ad4894d6 WatchSource:0}: Error finding container c1ef48874c93e5cff61f4d8de383ad5bfaf97f25491629f53ec16d93ad4894d6: Status 404 returned error can't find the container with id c1ef48874c93e5cff61f4d8de383ad5bfaf97f25491629f53ec16d93ad4894d6 Jul 16 03:44:23.375363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.375343 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 03:44:23.381322 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:23.381297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd53d53b99b482f488ac1acbac81aed8.slice/crio-f1556a6616ddedb6bf8b5af44d2bdaae08810d6c914fcf9f7d330439896f58be WatchSource:0}: Error finding container f1556a6616ddedb6bf8b5af44d2bdaae08810d6c914fcf9f7d330439896f58be: Status 404 returned error can't find the container with id f1556a6616ddedb6bf8b5af44d2bdaae08810d6c914fcf9f7d330439896f58be Jul 16 03:44:23.418562 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.418524 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.521442 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:23.521366 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-168.ec2.internal\" not found" Jul 16 03:44:23.618347 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.618309 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:23.621403 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.621386 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" Jul 16 03:44:23.631368 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.631352 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 03:44:23.632350 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.632326 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" Jul 16 03:44:23.641958 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:23.641944 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 03:44:24.096075 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.096046 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:24.205664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.205634 2583 apiserver.go:52] "Watching apiserver" Jul 16 03:44:24.213074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.213044 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 03:44:24.213634 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.213609 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zt7cr","kube-system/global-pull-secret-syncer-l7742","kube-system/konnectivity-agent-mrhkd","kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal","openshift-dns/node-resolver-kg96f","openshift-multus/multus-additional-cni-plugins-rpq5m","openshift-network-diagnostics/network-check-target-pnp89","openshift-network-operator/iptables-alerter-rmsxr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv","openshift-cluster-node-tuning-operator/tuned-r6qdx","openshift-image-registry/node-ca-49hgq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal","openshift-multus/multus-fwr2g","openshift-multus/network-metrics-daemon-w4nkf"] Jul 16 03:44:24.216399 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.216287 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.218643 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.218525 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.219157 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.218854 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-db6th\"" Jul 16 03:44:24.219157 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.219049 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.219309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.219177 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.222281 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.222579 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.222613 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.222765 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.222994 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.223685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.223121 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-846q7\"" Jul 16 03:44:24.224006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.223883 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.226386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.226163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.226386 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.226230 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:24.226386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.226278 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 03:44:24.226386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.226363 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 03:44:24.226691 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.226534 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-52qf9\"" Jul 16 03:44:24.228535 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.228515 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.231013 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.230993 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6xlc\"" Jul 16 03:44:24.231439 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.231421 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.231704 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.231685 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.231961 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.231893 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.233207 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.233188 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.233356 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.233321 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 03:44:24.234275 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.234256 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 03:44:24.234378 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.234327 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.235905 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-conf\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.235951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x82lc\" (UniqueName: \"kubernetes.io/projected/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-kube-api-access-x82lc\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.235985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-multus-daemon-config\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-sys\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-cnibin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236078 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236070 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-cni-binary-copy\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-k8s-cni-cncf-io\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-multus-certs\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysconfig\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236263 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-kubernetes\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236348 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-system-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236378 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-os-release\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236417 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236408 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-conf-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236436 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/210db13e-eab4-40fa-8749-cc10d87d1fb5-agent-certs\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-systemd\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-host\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236720 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-bin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236748 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4c5p\" (UniqueName: \"kubernetes.io/projected/c2f85585-aee0-4179-be2e-37fe166023a4-kube-api-access-g4c5p\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236759 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.236789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-lib-modules\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-var-lib-kubelet\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236851 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-tuned\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236879 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-netns\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236905 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-etc-kubernetes\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236931 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-tmp\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236953 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.236982 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-kubelet\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-modprobe-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-run\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.237113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-socket-dir-parent\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237549 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237126 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-multus\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237549 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-hostroot\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.237549 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/210db13e-eab4-40fa-8749-cc10d87d1fb5-konnectivity-ca\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.237549 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237221 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88f9m\"" Jul 16 03:44:24.237901 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.237880 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b29pt\"" Jul 16 03:44:24.238273 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.238255 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.239122 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.238560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:24.239122 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.238632 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:24.241540 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.241469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.241629 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.241577 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:24.243716 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.243696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.245933 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.245898 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.246602 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.246215 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.247324 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247181 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2spxk\"" Jul 16 03:44:24.247324 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247192 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.247324 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247203 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 03:44:24.247578 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247309 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 03:44:24.247578 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247444 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 03:44:24.247873 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.247856 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 03:44:24.248760 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.248584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.249583 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.249563 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.249918 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.249899 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 03:44:24.250012 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.249920 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v2j7l\"" Jul 16 03:44:24.250188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.250172 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.250859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.250841 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 03:44:24.251203 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.251172 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 03:44:24.251279 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.251232 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 03:44:24.251400 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.251172 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4b5lw\"" Jul 16 03:44:24.253031 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.253011 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4x6c" Jul 16 03:44:24.261554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.261536 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4x6c" Jul 16 03:44:24.322640 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.322525 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 03:44:24.329154 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.329094 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" event={"ID":"dd53d53b99b482f488ac1acbac81aed8","Type":"ContainerStarted","Data":"f1556a6616ddedb6bf8b5af44d2bdaae08810d6c914fcf9f7d330439896f58be"} Jul 16 03:44:24.331149 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.331127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" event={"ID":"8c5b7472850cd0aeba254c850e4f4352","Type":"ContainerStarted","Data":"c1ef48874c93e5cff61f4d8de383ad5bfaf97f25491629f53ec16d93ad4894d6"} Jul 16 03:44:24.338450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-cnibin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338552 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338464 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-k8s-cni-cncf-io\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338552 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-multus-certs\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338655 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338577 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-cnibin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338655 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338630 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-multus-certs\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338655 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-systemd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338674 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjj2s\" (UniqueName: \"kubernetes.io/projected/606c7c94-cb4d-440b-bed1-707f09e22592-kube-api-access-sjj2s\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysconfig\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-os-release\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338760 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-k8s-cni-cncf-io\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338746 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysconfig\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.338806 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338781 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbg5\" (UniqueName: \"kubernetes.io/projected/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-kube-api-access-whbg5\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-socket-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338809 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-os-release\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338838 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-ovn\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-netns\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338913 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-etc-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-config\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.338975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606c7c94-cb4d-440b-bed1-707f09e22592-ovn-node-metrics-cert\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339025 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-systemd\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.339093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4c5p\" (UniqueName: \"kubernetes.io/projected/c2f85585-aee0-4179-be2e-37fe166023a4-kube-api-access-g4c5p\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339100 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-systemd\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339184 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-netd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339212 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-env-overrides\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/786267a6-611c-4a46-a834-6c9752f4649b-serviceca\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-lib-modules\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339297 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-tuned\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-netns\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3ed9de7-db3e-459b-a8e9-b460f6630134-iptables-alerter-script\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339476 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339483 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-run-netns\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-kubelet\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jq4x\" (UniqueName: \"kubernetes.io/projected/786267a6-611c-4a46-a834-6c9752f4649b-kube-api-access-7jq4x\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339577 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-run\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-socket-dir-parent\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.339632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-hostroot\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339628 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-lib-modules\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339630 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339646 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2dg\" (UniqueName: \"kubernetes.io/projected/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kube-api-access-mk2dg\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339687 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-kubelet\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339732 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-run\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339766 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-socket-dir-parent\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339794 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-hostroot\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339795 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339879 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-sys-fs\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82lc\" (UniqueName: \"kubernetes.io/projected/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-kube-api-access-x82lc\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339952 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-multus-daemon-config\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.339987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340008 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9329d0f0-474e-4793-9372-6c57fb99d016-hosts-file\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9329d0f0-474e-4793-9372-6c57fb99d016-tmp-dir\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340073 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-registration-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.340514 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-dbus\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-sys\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-cni-binary-copy\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ld8k\" (UniqueName: \"kubernetes.io/projected/9329d0f0-474e-4793-9372-6c57fb99d016-kube-api-access-6ld8k\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340252 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-bin\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340328 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-sys\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-script-lib\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340420 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-kubernetes\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-system-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340488 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ed9de7-db3e-459b-a8e9-b460f6630134-host-slash\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340510 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-slash\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-conf-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340612 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/210db13e-eab4-40fa-8749-cc10d87d1fb5-agent-certs\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340614 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-multus-daemon-config\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.341301 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-host\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-bin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-node-log\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786267a6-611c-4a46-a834-6c9752f4649b-host\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-var-lib-kubelet\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-etc-kubernetes\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340922 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2f85585-aee0-4179-be2e-37fe166023a4-cni-binary-copy\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340942 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-cnibin\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.340997 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-os-release\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-kubernetes\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341077 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-system-cni-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341112 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-multus-conf-dir\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341130 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-host\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341156 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-var-lib-kubelet\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341164 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-bin\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.342115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341223 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pc8\" (UniqueName: \"kubernetes.io/projected/9e6bfc25-3809-4c30-8def-6d43d333680f-kube-api-access-z9pc8\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-kubelet\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341267 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-etc-kubernetes\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-tmp\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4qc\" (UniqueName: \"kubernetes.io/projected/d3ed9de7-db3e-459b-a8e9-b460f6630134-kube-api-access-6s4qc\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341436 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-device-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-systemd-units\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-var-lib-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-modprobe-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-multus\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/210db13e-eab4-40fa-8749-cc10d87d1fb5-konnectivity-ca\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341650 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-system-cni-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341670 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-kubelet-config\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341704 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-log-socket\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-conf\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.342909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341856 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.343544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341884 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.343544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.341992 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-sysctl-conf\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.343544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.342043 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-modprobe-d\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.343544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.342096 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2f85585-aee0-4179-be2e-37fe166023a4-host-var-lib-cni-multus\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.343544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.342175 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/210db13e-eab4-40fa-8749-cc10d87d1fb5-konnectivity-ca\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.344495 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.344474 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-etc-tuned\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.344961 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.344941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/210db13e-eab4-40fa-8749-cc10d87d1fb5-agent-certs\") pod \"konnectivity-agent-mrhkd\" (UID: \"210db13e-eab4-40fa-8749-cc10d87d1fb5\") " pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.347975 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.347897 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4c5p\" (UniqueName: \"kubernetes.io/projected/c2f85585-aee0-4179-be2e-37fe166023a4-kube-api-access-g4c5p\") pod \"multus-fwr2g\" (UID: \"c2f85585-aee0-4179-be2e-37fe166023a4\") " pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.353087 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.350622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x82lc\" (UniqueName: \"kubernetes.io/projected/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-kube-api-access-x82lc\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.353198 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.353173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c549c2c-3323-47a7-81ed-c2f9d2a3e088-tmp\") pod \"tuned-r6qdx\" (UID: \"5c549c2c-3323-47a7-81ed-c2f9d2a3e088\") " pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.442420 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-sys-fs\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.442420 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.442420 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9329d0f0-474e-4793-9372-6c57fb99d016-hosts-file\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.442420 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442364 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-sys-fs\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.442474 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442477 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9329d0f0-474e-4793-9372-6c57fb99d016-hosts-file\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9329d0f0-474e-4793-9372-6c57fb99d016-tmp-dir\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.442551 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:24.942532185 +0000 UTC m=+3.062077591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-registration-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-dbus\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ld8k\" (UniqueName: \"kubernetes.io/projected/9329d0f0-474e-4793-9372-6c57fb99d016-kube-api-access-6ld8k\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-bin\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442730 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-registration-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442744 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-script-lib\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ed9de7-db3e-459b-a8e9-b460f6630134-host-slash\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.442792 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-slash\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-node-log\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-dbus\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786267a6-611c-4a46-a834-6c9752f4649b-host\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786267a6-611c-4a46-a834-6c9752f4649b-host\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-cnibin\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.442999 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-bin\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-os-release\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-slash\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443079 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-node-log\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443098 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-os-release\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.443109 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443146 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ed9de7-db3e-459b-a8e9-b460f6630134-host-slash\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.443167 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:24.943147938 +0000 UTC m=+3.062693357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:24.443459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443188 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-cnibin\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443204 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pc8\" (UniqueName: \"kubernetes.io/projected/9e6bfc25-3809-4c30-8def-6d43d333680f-kube-api-access-z9pc8\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-kubelet\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4qc\" (UniqueName: \"kubernetes.io/projected/d3ed9de7-db3e-459b-a8e9-b460f6630134-kube-api-access-6s4qc\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443303 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-kubelet\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443304 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9329d0f0-474e-4793-9372-6c57fb99d016-tmp-dir\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443353 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-device-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443391 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-systemd-units\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-var-lib-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-system-cni-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-kubelet-config\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443479 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-device-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443497 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-systemd-units\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-log-socket\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443532 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-system-cni-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443543 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-var-lib-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443582 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-kubelet-config\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.444181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443588 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-log-socket\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443615 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443648 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443677 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443744 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-systemd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjj2s\" (UniqueName: \"kubernetes.io/projected/606c7c94-cb4d-440b-bed1-707f09e22592-kube-api-access-sjj2s\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbg5\" (UniqueName: \"kubernetes.io/projected/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-kube-api-access-whbg5\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443816 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6bfc25-3809-4c30-8def-6d43d333680f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443826 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-socket-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443847 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-systemd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443878 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-ovn\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-ovn\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:24.445048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443922 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-netns\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443932 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-socket-dir\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.443960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-run-netns\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-etc-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444067 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-config\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444070 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-etc-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444176 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606c7c94-cb4d-440b-bed1-707f09e22592-ovn-node-metrics-cert\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-netd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-env-overrides\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444273 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-script-lib\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/786267a6-611c-4a46-a834-6c9752f4649b-serviceca\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3ed9de7-db3e-459b-a8e9-b460f6630134-iptables-alerter-script\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jq4x\" (UniqueName: \"kubernetes.io/projected/786267a6-611c-4a46-a834-6c9752f4649b-kube-api-access-7jq4x\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444447 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-run-openvswitch\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444411 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-cni-netd\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.445876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444467 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2dg\" (UniqueName: \"kubernetes.io/projected/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kube-api-access-mk2dg\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-ovnkube-config\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444560 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606c7c94-cb4d-440b-bed1-707f09e22592-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.444900 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606c7c94-cb4d-440b-bed1-707f09e22592-env-overrides\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.445053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6bfc25-3809-4c30-8def-6d43d333680f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.445123 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3ed9de7-db3e-459b-a8e9-b460f6630134-iptables-alerter-script\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.446664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.445195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/786267a6-611c-4a46-a834-6c9752f4649b-serviceca\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.447174 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.447152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606c7c94-cb4d-440b-bed1-707f09e22592-ovn-node-metrics-cert\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.451293 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.451273 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:24.451417 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.451301 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:24.451417 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.451314 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:24.451417 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.451385 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:24.951368263 +0000 UTC m=+3.070913676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:24.453249 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.453193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ld8k\" (UniqueName: \"kubernetes.io/projected/9329d0f0-474e-4793-9372-6c57fb99d016-kube-api-access-6ld8k\") pod \"node-resolver-kg96f\" (UID: \"9329d0f0-474e-4793-9372-6c57fb99d016\") " pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.454217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.453747 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4qc\" (UniqueName: \"kubernetes.io/projected/d3ed9de7-db3e-459b-a8e9-b460f6630134-kube-api-access-6s4qc\") pod \"iptables-alerter-rmsxr\" (UID: \"d3ed9de7-db3e-459b-a8e9-b460f6630134\") " pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.454217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.453777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pc8\" (UniqueName: \"kubernetes.io/projected/9e6bfc25-3809-4c30-8def-6d43d333680f-kube-api-access-z9pc8\") pod \"multus-additional-cni-plugins-rpq5m\" (UID: \"9e6bfc25-3809-4c30-8def-6d43d333680f\") " pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.454632 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.454612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2dg\" (UniqueName: \"kubernetes.io/projected/c492ed50-880b-4fbf-a1c9-7f56b97f86b7-kube-api-access-mk2dg\") pod \"aws-ebs-csi-driver-node-gvshv\" (UID: \"c492ed50-880b-4fbf-a1c9-7f56b97f86b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.455765 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.455743 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjj2s\" (UniqueName: \"kubernetes.io/projected/606c7c94-cb4d-440b-bed1-707f09e22592-kube-api-access-sjj2s\") pod \"ovnkube-node-zt7cr\" (UID: \"606c7c94-cb4d-440b-bed1-707f09e22592\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.456257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.456235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbg5\" (UniqueName: \"kubernetes.io/projected/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-kube-api-access-whbg5\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.456607 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.456586 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jq4x\" (UniqueName: \"kubernetes.io/projected/786267a6-611c-4a46-a834-6c9752f4649b-kube-api-access-7jq4x\") pod \"node-ca-49hgq\" (UID: \"786267a6-611c-4a46-a834-6c9752f4649b\") " pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.540094 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.540054 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" Jul 16 03:44:24.548109 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.548083 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fwr2g" Jul 16 03:44:24.556844 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.556818 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:24.562505 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.562472 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kg96f" Jul 16 03:44:24.570167 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.570147 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" Jul 16 03:44:24.579883 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.579862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" Jul 16 03:44:24.586224 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.586207 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:24.594367 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.594349 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49hgq" Jul 16 03:44:24.601835 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.601798 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmsxr" Jul 16 03:44:24.947024 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.946996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:24.947024 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:24.947030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:24.947239 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.947139 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:24.947239 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.947142 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:24.947239 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.947191 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:25.947175383 +0000 UTC m=+4.066720790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:24.947239 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:24.947207 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:25.947199239 +0000 UTC m=+4.066744646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:25.048056 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.048023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:25.048212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.048150 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:25.048212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.048168 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:25.048212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.048176 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:25.048404 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.048229 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:26.048216275 +0000 UTC m=+4.167761681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:25.093700 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.093669 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 03:44:25.252432 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.252406 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f85585_aee0_4179_be2e_37fe166023a4.slice/crio-c20bd54cbf2644e3b3b05d44ce728346f7d5fd0c58723d9551cbc512c363e548 WatchSource:0}: Error finding container c20bd54cbf2644e3b3b05d44ce728346f7d5fd0c58723d9551cbc512c363e548: Status 404 returned error can't find the container with id c20bd54cbf2644e3b3b05d44ce728346f7d5fd0c58723d9551cbc512c363e548 Jul 16 03:44:25.257882 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.257857 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c549c2c_3323_47a7_81ed_c2f9d2a3e088.slice/crio-be8bb12544739df5274747792067d9a02735173fa32302884b94bdf53b899fbe WatchSource:0}: Error finding container be8bb12544739df5274747792067d9a02735173fa32302884b94bdf53b899fbe: Status 404 returned error can't find the container with id be8bb12544739df5274747792067d9a02735173fa32302884b94bdf53b899fbe Jul 16 03:44:25.258403 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.258377 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc492ed50_880b_4fbf_a1c9_7f56b97f86b7.slice/crio-1863338f758bcc4e0d85eabc9d595fa317261af0b18fbc47113c577106f4c28b WatchSource:0}: Error finding container 1863338f758bcc4e0d85eabc9d595fa317261af0b18fbc47113c577106f4c28b: Status 404 returned error can't find the container with id 1863338f758bcc4e0d85eabc9d595fa317261af0b18fbc47113c577106f4c28b Jul 16 03:44:25.259642 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.259586 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ed9de7_db3e_459b_a8e9_b460f6630134.slice/crio-922ff74d7b0f84c2c38cda233e22e0a83bf1676092c1bfcfc0ced0e8c13b7a49 WatchSource:0}: Error finding container 922ff74d7b0f84c2c38cda233e22e0a83bf1676092c1bfcfc0ced0e8c13b7a49: Status 404 returned error can't find the container with id 922ff74d7b0f84c2c38cda233e22e0a83bf1676092c1bfcfc0ced0e8c13b7a49 Jul 16 03:44:25.261509 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.260495 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6bfc25_3809_4c30_8def_6d43d333680f.slice/crio-e8b9fa2f3bfb4a78333df735b2b20f8ba0e891cd72e3d442d21774ddb7c46897 WatchSource:0}: Error finding container e8b9fa2f3bfb4a78333df735b2b20f8ba0e891cd72e3d442d21774ddb7c46897: Status 404 returned error can't find the container with id e8b9fa2f3bfb4a78333df735b2b20f8ba0e891cd72e3d442d21774ddb7c46897 Jul 16 03:44:25.261509 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.261461 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9329d0f0_474e_4793_9372_6c57fb99d016.slice/crio-6bea7417231e3eec7b39f2ed7e1432da46c6226ca0b792ebead3e1a359aecc45 WatchSource:0}: Error finding container 6bea7417231e3eec7b39f2ed7e1432da46c6226ca0b792ebead3e1a359aecc45: Status 404 returned error can't find the container with id 6bea7417231e3eec7b39f2ed7e1432da46c6226ca0b792ebead3e1a359aecc45 Jul 16 03:44:25.263205 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.263186 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210db13e_eab4_40fa_8749_cc10d87d1fb5.slice/crio-eb25bf2c05de4e08e1a1ce91a74a7d2f2879e53d9f24146cf11546805d7315a4 WatchSource:0}: Error finding container eb25bf2c05de4e08e1a1ce91a74a7d2f2879e53d9f24146cf11546805d7315a4: Status 404 returned error can't find the container with id eb25bf2c05de4e08e1a1ce91a74a7d2f2879e53d9f24146cf11546805d7315a4 Jul 16 03:44:25.265598 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.265572 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 03:39:24 +0000 UTC" deadline="2028-01-25 23:11:46.459663233 +0000 UTC" Jul 16 03:44:25.265598 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.265596 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13411h27m21.194070002s" Jul 16 03:44:25.285990 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.285969 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786267a6_611c_4a46_a834_6c9752f4649b.slice/crio-d308d12a9db9d88fc9b85c8257c26de8732800196ec49562d37447dae684315a WatchSource:0}: Error finding container d308d12a9db9d88fc9b85c8257c26de8732800196ec49562d37447dae684315a: Status 404 returned error can't find the container with id d308d12a9db9d88fc9b85c8257c26de8732800196ec49562d37447dae684315a Jul 16 03:44:25.287077 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:25.287060 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606c7c94_cb4d_440b_bed1_707f09e22592.slice/crio-79ecc74ab1d67a918c709c3fd720ff1f8237284dda91afaa13bbe0fe00f270a7 WatchSource:0}: Error finding container 79ecc74ab1d67a918c709c3fd720ff1f8237284dda91afaa13bbe0fe00f270a7: Status 404 returned error can't find the container with id 79ecc74ab1d67a918c709c3fd720ff1f8237284dda91afaa13bbe0fe00f270a7 Jul 16 03:44:25.334314 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.334158 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" event={"ID":"c492ed50-880b-4fbf-a1c9-7f56b97f86b7","Type":"ContainerStarted","Data":"1863338f758bcc4e0d85eabc9d595fa317261af0b18fbc47113c577106f4c28b"} Jul 16 03:44:25.335362 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.335323 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fwr2g" event={"ID":"c2f85585-aee0-4179-be2e-37fe166023a4","Type":"ContainerStarted","Data":"c20bd54cbf2644e3b3b05d44ce728346f7d5fd0c58723d9551cbc512c363e548"} Jul 16 03:44:25.336580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.336527 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrhkd" event={"ID":"210db13e-eab4-40fa-8749-cc10d87d1fb5","Type":"ContainerStarted","Data":"eb25bf2c05de4e08e1a1ce91a74a7d2f2879e53d9f24146cf11546805d7315a4"} Jul 16 03:44:25.337781 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.337754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerStarted","Data":"e8b9fa2f3bfb4a78333df735b2b20f8ba0e891cd72e3d442d21774ddb7c46897"} Jul 16 03:44:25.338999 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.338972 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" event={"ID":"5c549c2c-3323-47a7-81ed-c2f9d2a3e088","Type":"ContainerStarted","Data":"be8bb12544739df5274747792067d9a02735173fa32302884b94bdf53b899fbe"} Jul 16 03:44:25.340310 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.340289 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"79ecc74ab1d67a918c709c3fd720ff1f8237284dda91afaa13bbe0fe00f270a7"} Jul 16 03:44:25.341473 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.341451 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49hgq" event={"ID":"786267a6-611c-4a46-a834-6c9752f4649b","Type":"ContainerStarted","Data":"d308d12a9db9d88fc9b85c8257c26de8732800196ec49562d37447dae684315a"} Jul 16 03:44:25.342639 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.342620 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kg96f" event={"ID":"9329d0f0-474e-4793-9372-6c57fb99d016","Type":"ContainerStarted","Data":"6bea7417231e3eec7b39f2ed7e1432da46c6226ca0b792ebead3e1a359aecc45"} Jul 16 03:44:25.343781 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.343753 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmsxr" event={"ID":"d3ed9de7-db3e-459b-a8e9-b460f6630134","Type":"ContainerStarted","Data":"922ff74d7b0f84c2c38cda233e22e0a83bf1676092c1bfcfc0ced0e8c13b7a49"} Jul 16 03:44:25.955997 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.955957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:25.956158 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:25.956018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:25.956216 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.956172 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:25.956268 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.956233 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:27.956215136 +0000 UTC m=+6.075760549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:25.956661 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.956638 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:25.956752 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:25.956691 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:27.95667631 +0000 UTC m=+6.076221719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:26.057903 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.057251 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:26.057903 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.057423 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:26.057903 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.057446 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:26.057903 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.057458 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:26.057903 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.057517 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:28.05749821 +0000 UTC m=+6.177043623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:26.266598 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.266484 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 03:39:24 +0000 UTC" deadline="2028-02-20 14:15:03.114429822 +0000 UTC" Jul 16 03:44:26.266598 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.266550 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14026h30m36.847884817s" Jul 16 03:44:26.326030 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.325999 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:26.326189 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.326127 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:26.326554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.326534 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:26.326652 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.326633 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:26.326720 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.326708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:26.326805 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:26.326786 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:26.360968 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.360292 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" event={"ID":"8c5b7472850cd0aeba254c850e4f4352","Type":"ContainerStarted","Data":"c185f8d905ff40b11b7fe6489e955c8cfe7e04ef07be3b3c5243af8361801bcf"} Jul 16 03:44:26.370192 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.370060 2583 generic.go:356] "Generic (PLEG): container finished" podID="dd53d53b99b482f488ac1acbac81aed8" containerID="f0886a3ac42af2fb0bc0facaacc6f1d2b8b8a6a77f5e8ab7045fd5fedc42ec32" exitCode=0 Jul 16 03:44:26.370192 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.370108 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" event={"ID":"dd53d53b99b482f488ac1acbac81aed8","Type":"ContainerDied","Data":"f0886a3ac42af2fb0bc0facaacc6f1d2b8b8a6a77f5e8ab7045fd5fedc42ec32"} Jul 16 03:44:26.376108 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:26.376055 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-168.ec2.internal" podStartSLOduration=3.376036418 podStartE2EDuration="3.376036418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:26.375057042 +0000 UTC m=+4.494602496" watchObservedRunningTime="2026-07-16 03:44:26.376036418 +0000 UTC m=+4.495581849" Jul 16 03:44:27.397635 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:27.397553 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" event={"ID":"dd53d53b99b482f488ac1acbac81aed8","Type":"ContainerStarted","Data":"5c4c82e054131775dabf849faa899fd375489a4bccf92d3dd497d2530014fdd4"} Jul 16 03:44:27.973246 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:27.973207 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:27.973468 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:27.973311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:27.973468 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:27.973374 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:27.973468 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:27.973402 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:27.973468 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:27.973440 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:31.973421394 +0000 UTC m=+10.092966823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:27.973468 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:27.973460 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:31.973450814 +0000 UTC m=+10.092996221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:28.073837 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:28.073798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:28.074074 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.074058 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:28.074143 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.074082 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:28.074143 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.074095 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:28.074246 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.074187 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:32.074133088 +0000 UTC m=+10.193678510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:28.326152 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:28.326073 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:28.326317 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:28.326084 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:28.326317 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:28.326214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:28.326317 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.326213 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:28.326505 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.326321 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:28.326505 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:28.326405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:30.324089 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:30.324053 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:30.324594 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:30.324194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:30.324594 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:30.324204 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:30.324594 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:30.324302 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:30.324594 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:30.324349 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:30.324594 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:30.324424 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.009051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.009101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.009225 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.009285 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:40.009268058 +0000 UTC m=+18.128813469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.009224 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:32.009361 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.009374 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:40.009354919 +0000 UTC m=+18.128900340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:32.109976 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.109898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:32.110157 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.110088 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:32.110157 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.110114 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:32.110157 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.110124 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:32.110293 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.110183 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:40.110167135 +0000 UTC m=+18.229712542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:32.326927 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.326845 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:32.327509 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.327081 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:32.327509 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.327251 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:32.327509 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.327080 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:32.327509 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:32.327350 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:32.327509 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:32.327465 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:34.324648 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:34.324614 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:34.324648 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:34.324648 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:34.325123 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:34.324614 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:34.325123 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:34.324759 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:34.325123 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:34.324836 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:34.325123 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:34.324915 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:36.324172 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:36.324074 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:36.324616 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:36.324207 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:36.324616 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:36.324212 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:36.324616 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:36.324348 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:36.324616 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:36.324369 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:36.324616 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:36.324487 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:38.324435 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:38.324393 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:38.324435 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:38.324419 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:38.324919 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:38.324393 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:38.324919 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:38.324536 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:38.324919 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:38.324632 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:38.324919 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:38.324721 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:40.071374 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.071314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:40.071874 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.071382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:40.071874 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.071487 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:40.071874 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.071490 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:40.071874 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.071559 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:56.07153939 +0000 UTC m=+34.191084814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:40.071874 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.071579 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:44:56.071569135 +0000 UTC m=+34.191114545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:40.172730 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.172694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:40.172894 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.172835 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:40.172894 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.172857 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:40.172894 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.172867 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:40.173011 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.172921 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:56.172904558 +0000 UTC m=+34.292449986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:40.324267 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.324181 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:40.324267 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.324211 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:40.324499 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:40.324181 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:40.324499 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.324292 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:40.324499 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.324422 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:40.324705 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:40.324508 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:42.324758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:42.324720 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:42.325238 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:42.324846 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:42.325238 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:42.324852 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:42.325238 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:42.324881 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:42.325238 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:42.324944 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:42.325238 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:42.325032 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:44.324411 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.324085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:44.325048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.324088 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:44.325048 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:44.324493 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:44.325048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.324146 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:44.325048 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:44.324589 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:44.325048 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:44.324690 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:44.433801 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.433739 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"6d7f269bfecf1011826b7651e736ddbbcc567476b9670d84502a925fdd928b4e"} Jul 16 03:44:44.433981 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.433822 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"d301d99833736f91f4a99811b063b5a9d180d153d3014890fc6ea28162a668e5"} Jul 16 03:44:44.433981 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.433866 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"26425344e93522263cd4907d3a5076d2f4374e2b40ca5323f9b5469164a8e768"} Jul 16 03:44:44.433981 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.433911 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"0771bd881feb45453b334ba527fc835d110a68a215fb687b8a2e46da0bc45de3"} Jul 16 03:44:44.433981 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.433958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"a5cd7725950ef35d19b789250b04ff88f4e7fa5708c27aecbd80bf6eba887b6b"} Jul 16 03:44:44.434176 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.434009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"1f7cba19822fe0cbd3020ccbbdc7e79b95de25e161ee57a814180edb4e5d1f1c"} Jul 16 03:44:44.435428 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.435371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49hgq" event={"ID":"786267a6-611c-4a46-a834-6c9752f4649b","Type":"ContainerStarted","Data":"1ea49ef40cb8da41262ff6be7c03450a89ee4ba0cd7ae1a4563a5ae65c2f7ed4"} Jul 16 03:44:44.437095 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.437061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kg96f" event={"ID":"9329d0f0-474e-4793-9372-6c57fb99d016","Type":"ContainerStarted","Data":"61f5fb8007a455d65ea8dc4122b9877c227f6b9707a62967aa51b8783f38a1cb"} Jul 16 03:44:44.438687 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.438665 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" event={"ID":"c492ed50-880b-4fbf-a1c9-7f56b97f86b7","Type":"ContainerStarted","Data":"90fa7632f53b7115708ef2e04cd6ed9d5ace322356f393fb401b5fc1b9505a6c"} Jul 16 03:44:44.440265 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.440241 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fwr2g" event={"ID":"c2f85585-aee0-4179-be2e-37fe166023a4","Type":"ContainerStarted","Data":"a1652d0688708a3b4eba8a05ac5a59e9ac155db025169d60f4450a7f64d6775c"} Jul 16 03:44:44.442246 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.442219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrhkd" event={"ID":"210db13e-eab4-40fa-8749-cc10d87d1fb5","Type":"ContainerStarted","Data":"49c80a5ca7b6b975cc79d2583265c6b80569b4d4c6bfadc248b130dae1c8fd69"} Jul 16 03:44:44.443835 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.443814 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="3883ae0bac0a8e3d5f1a87797115c31e03ef26860764ee14871128d5399da815" exitCode=0 Jul 16 03:44:44.443930 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.443891 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"3883ae0bac0a8e3d5f1a87797115c31e03ef26860764ee14871128d5399da815"} Jul 16 03:44:44.445558 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.445537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" event={"ID":"5c549c2c-3323-47a7-81ed-c2f9d2a3e088","Type":"ContainerStarted","Data":"1dbdd42803bdd1fd2120766cbb117b3f59d99e2ca13323b1363d42206317360b"} Jul 16 03:44:44.457148 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.457113 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-168.ec2.internal" podStartSLOduration=21.457100755 podStartE2EDuration="21.457100755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:27.414868992 +0000 UTC m=+5.534414423" watchObservedRunningTime="2026-07-16 03:44:44.457100755 +0000 UTC m=+22.576646188" Jul 16 03:44:44.480636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.480587 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kg96f" podStartSLOduration=3.968590279 podStartE2EDuration="22.480568412s" totalImagesPullingTime="18.511978133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:44.480545235 +0000 UTC m=+22.600090667" watchObservedRunningTime="2026-07-16 03:44:44.480568412 +0000 UTC m=+22.600113842" Jul 16 03:44:44.481174 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.481135 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-49hgq" podStartSLOduration=3.9827078350000003 podStartE2EDuration="22.481121086s" totalImagesPullingTime="18.498413251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:44.457148477 +0000 UTC m=+22.576693907" watchObservedRunningTime="2026-07-16 03:44:44.481121086 +0000 UTC m=+22.600666518" Jul 16 03:44:44.532249 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.532162 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6qdx" podStartSLOduration=4.005839204 podStartE2EDuration="22.53214042s" totalImagesPullingTime="18.526301216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:44.531508126 +0000 UTC m=+22.651053554" watchObservedRunningTime="2026-07-16 03:44:44.53214042 +0000 UTC m=+22.651685853" Jul 16 03:44:44.552889 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.552794 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fwr2g" podStartSLOduration=3.962773265 podStartE2EDuration="22.552774329s" totalImagesPullingTime="18.590001064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:44.552378197 +0000 UTC m=+22.671923646" watchObservedRunningTime="2026-07-16 03:44:44.552774329 +0000 UTC m=+22.672319755" Jul 16 03:44:44.570183 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:44.570137 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mrhkd" podStartSLOduration=4.068508149 podStartE2EDuration="22.570121238s" totalImagesPullingTime="18.501613089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:44.569655207 +0000 UTC m=+22.689200636" watchObservedRunningTime="2026-07-16 03:44:44.570121238 +0000 UTC m=+22.689666698" Jul 16 03:44:45.234781 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.234750 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 03:44:45.289938 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.289834 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T03:44:45.234775774Z","UUID":"4f7a5881-fcf6-469a-b9da-dd4e089855e7","Handler":null,"Name":"","Endpoint":""} Jul 16 03:44:45.291523 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.291502 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 03:44:45.291648 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.291541 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 03:44:45.449065 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.448987 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmsxr" event={"ID":"d3ed9de7-db3e-459b-a8e9-b460f6630134","Type":"ContainerStarted","Data":"2633713b62eb3c95a65479c43a47b4e546e2b8d34002228ea79772b32959d386"} Jul 16 03:44:45.451055 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.451026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" event={"ID":"c492ed50-880b-4fbf-a1c9-7f56b97f86b7","Type":"ContainerStarted","Data":"c32b94b61394a7f4bea44d8f8950b069d39669ab321adef76268e76abdc89ad1"} Jul 16 03:44:45.465281 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:45.465241 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rmsxr" podStartSLOduration=4.936920548 podStartE2EDuration="23.46522256s" totalImagesPullingTime="18.528302012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:45.464855198 +0000 UTC m=+23.584400626" watchObservedRunningTime="2026-07-16 03:44:45.46522256 +0000 UTC m=+23.584768084" Jul 16 03:44:46.324549 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:46.324519 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:46.324833 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:46.324515 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:46.324833 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:46.324637 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:46.324833 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:46.324644 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:46.324833 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:46.324780 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:46.325038 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:46.324865 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:47.460384 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:47.460133 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"6ea7bd0c69439e24bb6a7cf520f5efb9fb23f6af45e73bf070e6a265bc79cfe4"} Jul 16 03:44:47.462351 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:47.462310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" event={"ID":"c492ed50-880b-4fbf-a1c9-7f56b97f86b7","Type":"ContainerStarted","Data":"ff0e2c564e834665aa6fca52a0bd0252f9895254946a53fb02c37068eabdbf2d"} Jul 16 03:44:47.481217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:47.481169 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvshv" podStartSLOduration=4.6457248060000005 podStartE2EDuration="25.481155425s" totalImagesPullingTime="20.835430619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:47.480572136 +0000 UTC m=+25.600117562" watchObservedRunningTime="2026-07-16 03:44:47.481155425 +0000 UTC m=+25.600700853" Jul 16 03:44:48.324221 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:48.324185 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:48.324471 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:48.324184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:48.324471 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:48.324321 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:48.324471 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:48.324184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:48.324471 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:48.324424 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:48.324655 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:48.324489 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:48.352741 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:48.352708 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:48.353278 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:48.353258 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:49.470597 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.470314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" event={"ID":"606c7c94-cb4d-440b-bed1-707f09e22592","Type":"ContainerStarted","Data":"66bbec8ba7d7680b1f7516aaa692c2db7153b632ad45efdd5f3f1d22393b92eb"} Jul 16 03:44:49.471287 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.470653 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:49.472030 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.472004 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="a5a55e572cc71950f50396d1b87bc1f0c3388fe6d8cfad2c24f8c076fddc5bcf" exitCode=0 Jul 16 03:44:49.472147 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.472042 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"a5a55e572cc71950f50396d1b87bc1f0c3388fe6d8cfad2c24f8c076fddc5bcf"} Jul 16 03:44:49.487105 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.487081 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:49.498685 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:49.498646 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" podStartSLOduration=8.932859331 podStartE2EDuration="27.498632685s" totalImagesPullingTime="18.565773354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:49.498064352 +0000 UTC m=+27.617609799" watchObservedRunningTime="2026-07-16 03:44:49.498632685 +0000 UTC m=+27.618178114" Jul 16 03:44:50.324122 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.324055 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:50.324352 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.324065 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:50.324352 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.324170 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:50.324352 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.324257 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:50.324352 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.324065 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:50.324532 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.324418 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:50.480159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.480127 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:50.480526 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.480221 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:50.499667 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.499638 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:44:50.712544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.712297 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l7742"] Jul 16 03:44:50.712736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.712645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:50.712796 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.712742 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:50.713066 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.713040 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4nkf"] Jul 16 03:44:50.713209 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.713138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:50.713275 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.713238 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:50.713642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.713620 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnp89"] Jul 16 03:44:50.713738 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:50.713695 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:50.713792 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:50.713763 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:51.477821 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:51.477787 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="563dc846602f1ae1341e589af7492939186a71fcb78cff8f22c14849ec58ca6b" exitCode=0 Jul 16 03:44:51.478003 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:51.477852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"563dc846602f1ae1341e589af7492939186a71fcb78cff8f22c14849ec58ca6b"} Jul 16 03:44:52.325278 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.325252 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:52.325678 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:52.325360 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:52.325678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.325366 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:52.325678 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:52.325444 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:52.325678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.325462 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:52.325678 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:52.325499 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:52.665011 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.664681 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:52.665011 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.664822 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 03:44:52.665500 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:52.665475 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrhkd" Jul 16 03:44:53.484305 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:53.484220 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="4f1930a88e46a7b8238fdeba326a65381614e05240299a76bf7e940b6474651d" exitCode=0 Jul 16 03:44:53.484981 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:53.484295 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"4f1930a88e46a7b8238fdeba326a65381614e05240299a76bf7e940b6474651d"} Jul 16 03:44:54.324041 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:54.324004 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:54.324227 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:54.324052 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:54.324227 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:54.324003 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:54.324227 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:54.324136 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:54.324375 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:54.324231 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:54.324375 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:54.324289 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:56.091796 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.091731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:56.092217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.091804 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:56.092217 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.091924 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:56.092217 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.091985 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret podName:e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:28.09196594 +0000 UTC m=+66.211511354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret") pod "global-pull-secret-syncer-l7742" (UID: "e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8") : object "kube-system"/"original-pull-secret" not registered Jul 16 03:44:56.092217 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.091924 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:56.092217 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.092069 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs podName:6bfd1426-c9ef-4817-91c7-0a43f4ac3feb nodeName:}" failed. No retries permitted until 2026-07-16 03:45:28.092048442 +0000 UTC m=+66.211593859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs") pod "network-metrics-daemon-w4nkf" (UID: "6bfd1426-c9ef-4817-91c7-0a43f4ac3feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 03:44:56.192991 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.192957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:56.193212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.193178 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 03:44:56.193212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.193210 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 03:44:56.193212 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.193222 2583 projected.go:196] Error preparing data for projected volume kube-api-access-fq4w5 for pod openshift-network-diagnostics/network-check-target-pnp89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:56.193425 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.193272 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5 podName:f7e59f04-007d-4330-8b22-03a5a854a984 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:28.19325925 +0000 UTC m=+66.312804658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq4w5" (UniqueName: "kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5") pod "network-check-target-pnp89" (UID: "f7e59f04-007d-4330-8b22-03a5a854a984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 03:44:56.324406 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.324370 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:56.324406 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.324404 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:56.324630 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:56.324380 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:56.324630 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.324513 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4nkf" podUID="6bfd1426-c9ef-4817-91c7-0a43f4ac3feb" Jul 16 03:44:56.324727 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.324624 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnp89" podUID="f7e59f04-007d-4330-8b22-03a5a854a984" Jul 16 03:44:56.324770 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:56.324738 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l7742" podUID="e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8" Jul 16 03:44:57.495460 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.495254 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="396c7c695e0023fc13070f25bf2615eb408b14aa0f12da46eae19613a531d0d0" exitCode=0 Jul 16 03:44:57.495735 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.495298 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"396c7c695e0023fc13070f25bf2615eb408b14aa0f12da46eae19613a531d0d0"} Jul 16 03:44:57.682412 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.682387 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-168.ec2.internal" event="NodeReady" Jul 16 03:44:57.682560 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.682526 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 03:44:57.715563 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.715528 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:44:57.717110 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.717088 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.719693 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.719674 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 03:44:57.719975 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.719957 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 03:44:57.720043 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.720031 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xzf5d\"" Jul 16 03:44:57.720102 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.720039 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 03:44:57.731123 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.730831 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 03:44:57.732098 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.732076 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rhqzt"] Jul 16 03:44:57.733929 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.733914 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-66gx8"] Jul 16 03:44:57.734040 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.734025 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:57.735269 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.735251 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:57.736585 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.736557 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 03:44:57.736873 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.736856 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 03:44:57.737004 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.736988 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:44:57.737435 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.737412 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 03:44:57.737518 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.737412 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znrbk\"" Jul 16 03:44:57.737585 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.737420 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgpfk\"" Jul 16 03:44:57.737585 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.737570 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 03:44:57.737717 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.737703 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 03:44:57.742297 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.742276 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66gx8"] Jul 16 03:44:57.745671 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.745650 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rhqzt"] Jul 16 03:44:57.906946 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.906916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-config-volume\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.906961 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.906999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxhnq\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2zd7\" (UniqueName: \"kubernetes.io/projected/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-kube-api-access-n2zd7\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvfjn\" (UniqueName: \"kubernetes.io/projected/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-kube-api-access-zvfjn\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-cert\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:57.907136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907131 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907184 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907212 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-tmp-dir\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:57.907481 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:57.907418 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.007876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.007833 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.007876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.007875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxhnq\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.007890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2zd7\" (UniqueName: \"kubernetes.io/projected/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-kube-api-access-n2zd7\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.007922 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfjn\" (UniqueName: \"kubernetes.io/projected/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-kube-api-access-zvfjn\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.007938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.008011 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.008025 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-cert\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:58.008074 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.008076 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:58.508057539 +0000 UTC m=+36.627602951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008102 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008186 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-tmp-dir\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.008372 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:44:58.008441 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.008432 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:58.50841449 +0000 UTC m=+36.627959906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:44:58.008846 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-config-volume\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.008846 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008761 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-tmp-dir\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.008846 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.008797 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.009060 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.009036 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-config-volume\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.009163 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.009054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.009244 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.009222 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.011910 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.011891 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.012017 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.011967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.012017 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.012005 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-cert\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:58.016693 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.016668 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2zd7\" (UniqueName: \"kubernetes.io/projected/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-kube-api-access-n2zd7\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.017042 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.016958 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.017042 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.016964 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfjn\" (UniqueName: \"kubernetes.io/projected/d91c5d7b-b9af-41d9-a408-e488dba2d0c4-kube-api-access-zvfjn\") pod \"ingress-canary-66gx8\" (UID: \"d91c5d7b-b9af-41d9-a408-e488dba2d0c4\") " pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:58.017480 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.017444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxhnq\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.050920 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.050880 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66gx8" Jul 16 03:44:58.190978 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.190846 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66gx8"] Jul 16 03:44:58.194131 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:44:58.194108 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91c5d7b_b9af_41d9_a408_e488dba2d0c4.slice/crio-9bffce28b44b7e1abb622e397aa08eb3fce108b7c7c42e3eee8f94f121b673f3 WatchSource:0}: Error finding container 9bffce28b44b7e1abb622e397aa08eb3fce108b7c7c42e3eee8f94f121b673f3: Status 404 returned error can't find the container with id 9bffce28b44b7e1abb622e397aa08eb3fce108b7c7c42e3eee8f94f121b673f3 Jul 16 03:44:58.324644 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.324614 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:44:58.324819 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.324747 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:44:58.324819 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.324614 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:44:58.327832 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327770 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 03:44:58.327832 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327777 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 03:44:58.327832 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327797 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s75tt\"" Jul 16 03:44:58.328262 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327780 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 03:44:58.328262 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327870 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmnkf\"" Jul 16 03:44:58.328262 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.327780 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 03:44:58.500963 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.500883 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e6bfc25-3809-4c30-8def-6d43d333680f" containerID="48a832171ac9e29f6f0db4e824abd875198ec96834cdd649458169a9ff7dbdcf" exitCode=0 Jul 16 03:44:58.501320 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.500966 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerDied","Data":"48a832171ac9e29f6f0db4e824abd875198ec96834cdd649458169a9ff7dbdcf"} Jul 16 03:44:58.502387 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.502137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66gx8" event={"ID":"d91c5d7b-b9af-41d9-a408-e488dba2d0c4","Type":"ContainerStarted","Data":"9bffce28b44b7e1abb622e397aa08eb3fce108b7c7c42e3eee8f94f121b673f3"} Jul 16 03:44:58.512640 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.512622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:58.512736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:58.512651 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:58.512805 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.512752 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:44:58.512856 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.512810 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:59.512793794 +0000 UTC m=+37.632339216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:44:58.512856 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.512828 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:44:58.512856 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.512847 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:44:58.512976 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:58.512894 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:44:59.512878709 +0000 UTC m=+37.632424139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:44:59.509228 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:59.508985 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" event={"ID":"9e6bfc25-3809-4c30-8def-6d43d333680f","Type":"ContainerStarted","Data":"f9ff80496f39b505ca555296ae76c0648eec0adec00e7cd91eff600f484498c6"} Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:59.520595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:59.520650 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:59.520763 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:59.520779 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:59.520800 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:59.520835 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:01.520817665 +0000 UTC m=+39.640363075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:44:59.521152 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:44:59.520864 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:01.520846034 +0000 UTC m=+39.640391445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:44:59.535824 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:44:59.535770 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rpq5m" podStartSLOduration=8.710745566 podStartE2EDuration="37.535751272s" totalImagesPullingTime="28.825005706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:44:59.53403421 +0000 UTC m=+37.653579639" watchObservedRunningTime="2026-07-16 03:44:59.535751272 +0000 UTC m=+37.655296703" Jul 16 03:45:01.515023 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:01.514987 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66gx8" event={"ID":"d91c5d7b-b9af-41d9-a408-e488dba2d0c4","Type":"ContainerStarted","Data":"7286be854053f34335eaa0c760d660b6d60563e00ca5e14984e3fdacb9464306"} Jul 16 03:45:01.530657 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:01.530602 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-66gx8" podStartSLOduration=2.277741179 podStartE2EDuration="4.530583955s" totalImagesPullingTime="2.252842776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:01.530407715 +0000 UTC m=+39.649953169" watchObservedRunningTime="2026-07-16 03:45:01.530583955 +0000 UTC m=+39.650129405" Jul 16 03:45:01.537765 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:01.537736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:01.537909 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:01.537778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:01.537970 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:01.537918 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:45:01.537970 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:01.537940 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:45:01.538034 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:01.538005 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:05.537982895 +0000 UTC m=+43.657528317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:45:01.538079 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:01.538041 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:45:01.538117 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:01.538110 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:05.538090827 +0000 UTC m=+43.657636235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:45:05.564847 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:05.564802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:05.564847 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:05.564851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:05.565261 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:05.564952 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:45:05.565261 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:05.564974 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:45:05.565261 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:05.564957 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:45:05.565261 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:05.565028 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:13.565013922 +0000 UTC m=+51.684559328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:45:05.565261 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:05.565042 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:13.565036322 +0000 UTC m=+51.684581730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:45:07.382051 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.382014 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gd9rj"] Jul 16 03:45:07.421155 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.421124 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gd9rj"] Jul 16 03:45:07.421306 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.421250 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.425740 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.425717 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 03:45:07.425863 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.425815 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 03:45:07.425863 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.425820 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 03:45:07.426736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.426719 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrzxg\"" Jul 16 03:45:07.426814 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.426719 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 03:45:07.475859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.475819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.476048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.475911 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5680e09-96d8-4144-b374-ef7e690a4429-data-volume\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.476048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.475939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp79s\" (UniqueName: \"kubernetes.io/projected/c5680e09-96d8-4144-b374-ef7e690a4429-kube-api-access-kp79s\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.476048 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.476035 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5680e09-96d8-4144-b374-ef7e690a4429-crio-socket\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.476174 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.476063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576620 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5680e09-96d8-4144-b374-ef7e690a4429-crio-socket\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576620 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5680e09-96d8-4144-b374-ef7e690a4429-data-volume\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576710 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp79s\" (UniqueName: \"kubernetes.io/projected/c5680e09-96d8-4144-b374-ef7e690a4429-kube-api-access-kp79s\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:07.576716 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:07.576795 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:08.076778857 +0000 UTC m=+46.196324269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : configmap "kube-rbac-proxy" not found Jul 16 03:45:07.576843 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.576830 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5680e09-96d8-4144-b374-ef7e690a4429-crio-socket\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.577083 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:07.576838 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 03:45:07.577083 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:07.576928 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:08.076909013 +0000 UTC m=+46.196454441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : secret "insights-runtime-extractor-tls" not found Jul 16 03:45:07.577083 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.577068 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5680e09-96d8-4144-b374-ef7e690a4429-data-volume\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:07.593636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:07.593607 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp79s\" (UniqueName: \"kubernetes.io/projected/c5680e09-96d8-4144-b374-ef7e690a4429-kube-api-access-kp79s\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:08.079718 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:08.079676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:08.079718 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:08.079723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:08.079948 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:08.079791 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 03:45:08.079948 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:08.079856 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:09.079841403 +0000 UTC m=+47.199386810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : configmap "kube-rbac-proxy" not found Jul 16 03:45:08.079948 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:08.079861 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 03:45:08.079948 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:08.079908 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:09.079897127 +0000 UTC m=+47.199442534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : secret "insights-runtime-extractor-tls" not found Jul 16 03:45:09.086082 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.086049 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:09.086082 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.086084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:09.086529 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:09.086163 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 03:45:09.086529 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:09.086190 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 03:45:09.086529 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:09.086221 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:11.086206602 +0000 UTC m=+49.205752009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : configmap "kube-rbac-proxy" not found Jul 16 03:45:09.086529 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:09.086245 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:11.086234447 +0000 UTC m=+49.205779854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : secret "insights-runtime-extractor-tls" not found Jul 16 03:45:09.472990 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.472961 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kg96f_9329d0f0-474e-4793-9372-6c57fb99d016/dns-node-resolver/0.log" Jul 16 03:45:09.883713 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.883684 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dxksg"] Jul 16 03:45:09.916967 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.916942 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dxksg"] Jul 16 03:45:09.917105 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.917033 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:09.919811 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.919788 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 03:45:09.920664 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.920631 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 03:45:09.920765 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.920643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4c58k\"" Jul 16 03:45:09.920765 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.920704 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 03:45:09.920879 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.920763 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 03:45:09.992440 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.992413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-cabundle\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:09.992558 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.992480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-key\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:09.992558 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:09.992503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwsp\" (UniqueName: \"kubernetes.io/projected/185af3de-52f8-4fdb-bd1a-ed15d6954a84-kube-api-access-wpwsp\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.092842 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.092816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-cabundle\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.093159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.092870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-key\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.093159 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.092979 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwsp\" (UniqueName: \"kubernetes.io/projected/185af3de-52f8-4fdb-bd1a-ed15d6954a84-kube-api-access-wpwsp\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.093527 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.093500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-cabundle\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.095140 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.095123 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/185af3de-52f8-4fdb-bd1a-ed15d6954a84-signing-key\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.101346 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.101311 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwsp\" (UniqueName: \"kubernetes.io/projected/185af3de-52f8-4fdb-bd1a-ed15d6954a84-kube-api-access-wpwsp\") pod \"service-ca-79f68b9f4f-dxksg\" (UID: \"185af3de-52f8-4fdb-bd1a-ed15d6954a84\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.225936 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.225862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" Jul 16 03:45:10.273049 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.273019 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49hgq_786267a6-611c-4a46-a834-6c9752f4649b/node-ca/0.log" Jul 16 03:45:10.359508 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.359480 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dxksg"] Jul 16 03:45:10.362666 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:10.362642 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185af3de_52f8_4fdb_bd1a_ed15d6954a84.slice/crio-68a53edef5f2e6ea28164f4fb371de734a0fe608a271402becff56e093560d53 WatchSource:0}: Error finding container 68a53edef5f2e6ea28164f4fb371de734a0fe608a271402becff56e093560d53: Status 404 returned error can't find the container with id 68a53edef5f2e6ea28164f4fb371de734a0fe608a271402becff56e093560d53 Jul 16 03:45:10.536031 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:10.535948 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" event={"ID":"185af3de-52f8-4fdb-bd1a-ed15d6954a84","Type":"ContainerStarted","Data":"68a53edef5f2e6ea28164f4fb371de734a0fe608a271402becff56e093560d53"} Jul 16 03:45:11.073640 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:11.073610 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66gx8_d91c5d7b-b9af-41d9-a408-e488dba2d0c4/serve-healthcheck-canary/0.log" Jul 16 03:45:11.102106 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:11.102070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:11.102569 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:11.102126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:11.102569 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:11.102184 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 03:45:11.102569 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:11.102261 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:15.102240314 +0000 UTC m=+53.221785725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : configmap "kube-rbac-proxy" not found Jul 16 03:45:11.102569 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:11.102284 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 03:45:11.102569 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:11.102366 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:15.102348917 +0000 UTC m=+53.221894357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : secret "insights-runtime-extractor-tls" not found Jul 16 03:45:13.546947 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:13.546910 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" event={"ID":"185af3de-52f8-4fdb-bd1a-ed15d6954a84","Type":"ContainerStarted","Data":"e57599e77f1b2871d7093cac344c30138c9bb761c982e0e340ef1fce3da9ebdb"} Jul 16 03:45:13.565047 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:13.564999 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-dxksg" podStartSLOduration=2.452361358 podStartE2EDuration="4.564983998s" totalImagesPullingTime="2.11262264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:13.563692485 +0000 UTC m=+51.683237914" watchObservedRunningTime="2026-07-16 03:45:13.564983998 +0000 UTC m=+51.684529427" Jul 16 03:45:13.621618 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:13.621592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:13.621762 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:13.621717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:13.621762 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:13.621739 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 03:45:13.621864 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:13.621808 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls podName:d20f6bc8-3cf6-4ad9-85b1-a51699273a26 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:29.621793181 +0000 UTC m=+67.741338588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls") pod "dns-default-rhqzt" (UID: "d20f6bc8-3cf6-4ad9-85b1-a51699273a26") : secret "dns-default-metrics-tls" not found Jul 16 03:45:13.621943 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:13.621926 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 03:45:13.621999 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:13.621946 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f69557788-tffcj: secret "image-registry-tls" not found Jul 16 03:45:13.621999 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:13.621992 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls podName:ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:29.62197932 +0000 UTC m=+67.741524733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls") pod "image-registry-7f69557788-tffcj" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7") : secret "image-registry-tls" not found Jul 16 03:45:15.135345 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:15.135292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:15.135804 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:15.135361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:15.135804 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:15.135473 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 03:45:15.135804 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:45:15.135556 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls podName:c5680e09-96d8-4144-b374-ef7e690a4429 nodeName:}" failed. No retries permitted until 2026-07-16 03:45:23.135535439 +0000 UTC m=+61.255080849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gd9rj" (UID: "c5680e09-96d8-4144-b374-ef7e690a4429") : secret "insights-runtime-extractor-tls" not found Jul 16 03:45:15.135937 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:15.135915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5680e09-96d8-4144-b374-ef7e690a4429-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:22.493870 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:22.493843 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt7cr" Jul 16 03:45:23.199008 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.198972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:23.201227 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.201210 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5680e09-96d8-4144-b374-ef7e690a4429-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd9rj\" (UID: \"c5680e09-96d8-4144-b374-ef7e690a4429\") " pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:23.332376 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.332345 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrzxg\"" Jul 16 03:45:23.340566 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.340546 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gd9rj" Jul 16 03:45:23.486120 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.486047 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gd9rj"] Jul 16 03:45:23.489345 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:23.489304 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5680e09_96d8_4144_b374_ef7e690a4429.slice/crio-4c09d7bb75345e852f66c2f172dc6bc59c2a57f34550b70fba1c381e1bc36230 WatchSource:0}: Error finding container 4c09d7bb75345e852f66c2f172dc6bc59c2a57f34550b70fba1c381e1bc36230: Status 404 returned error can't find the container with id 4c09d7bb75345e852f66c2f172dc6bc59c2a57f34550b70fba1c381e1bc36230 Jul 16 03:45:23.571840 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:23.571811 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd9rj" event={"ID":"c5680e09-96d8-4144-b374-ef7e690a4429","Type":"ContainerStarted","Data":"4c09d7bb75345e852f66c2f172dc6bc59c2a57f34550b70fba1c381e1bc36230"} Jul 16 03:45:28.141426 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.141387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:45:28.141849 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.141439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:45:28.144263 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.144239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 03:45:28.144386 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.144239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 03:45:28.154710 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.154685 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8-original-pull-secret\") pod \"global-pull-secret-syncer-l7742\" (UID: \"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8\") " pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:45:28.154831 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.154783 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfd1426-c9ef-4817-91c7-0a43f4ac3feb-metrics-certs\") pod \"network-metrics-daemon-w4nkf\" (UID: \"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb\") " pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:45:28.242295 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.242260 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:45:28.245148 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.245130 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 03:45:28.255627 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.255604 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 03:45:28.265603 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.265582 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4w5\" (UniqueName: \"kubernetes.io/projected/f7e59f04-007d-4330-8b22-03a5a854a984-kube-api-access-fq4w5\") pod \"network-check-target-pnp89\" (UID: \"f7e59f04-007d-4330-8b22-03a5a854a984\") " pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:45:28.337671 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.337649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s75tt\"" Jul 16 03:45:28.340929 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.340908 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l7742" Jul 16 03:45:28.345629 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.345607 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:45:28.347859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.347744 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmnkf\"" Jul 16 03:45:28.356561 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.356541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4nkf" Jul 16 03:45:28.477177 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.477149 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l7742"] Jul 16 03:45:28.481409 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:28.481372 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07cf84d_3cfa_49fa_b1f0_13ad9e240ec8.slice/crio-072f920fb7cee0b2a40f03c001c14f6f5136868d7c7a8e19da522bb7927f81b8 WatchSource:0}: Error finding container 072f920fb7cee0b2a40f03c001c14f6f5136868d7c7a8e19da522bb7927f81b8: Status 404 returned error can't find the container with id 072f920fb7cee0b2a40f03c001c14f6f5136868d7c7a8e19da522bb7927f81b8 Jul 16 03:45:28.494393 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.494362 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnp89"] Jul 16 03:45:28.497632 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:28.497609 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e59f04_007d_4330_8b22_03a5a854a984.slice/crio-52e6b3af5e197e3abb55522349b2ac1baf597f125a276f7314a9b94b10b798c2 WatchSource:0}: Error finding container 52e6b3af5e197e3abb55522349b2ac1baf597f125a276f7314a9b94b10b798c2: Status 404 returned error can't find the container with id 52e6b3af5e197e3abb55522349b2ac1baf597f125a276f7314a9b94b10b798c2 Jul 16 03:45:28.508910 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.508886 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4nkf"] Jul 16 03:45:28.511527 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:28.511503 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfd1426_c9ef_4817_91c7_0a43f4ac3feb.slice/crio-b2d34ae86a22e1206067f12cd58f44fbd84fe11923f2544bf4ba894240e2d6b5 WatchSource:0}: Error finding container b2d34ae86a22e1206067f12cd58f44fbd84fe11923f2544bf4ba894240e2d6b5: Status 404 returned error can't find the container with id b2d34ae86a22e1206067f12cd58f44fbd84fe11923f2544bf4ba894240e2d6b5 Jul 16 03:45:28.585442 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.585408 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnp89" event={"ID":"f7e59f04-007d-4330-8b22-03a5a854a984","Type":"ContainerStarted","Data":"52e6b3af5e197e3abb55522349b2ac1baf597f125a276f7314a9b94b10b798c2"} Jul 16 03:45:28.586442 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.586412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l7742" event={"ID":"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8","Type":"ContainerStarted","Data":"072f920fb7cee0b2a40f03c001c14f6f5136868d7c7a8e19da522bb7927f81b8"} Jul 16 03:45:28.587482 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.587457 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4nkf" event={"ID":"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb","Type":"ContainerStarted","Data":"b2d34ae86a22e1206067f12cd58f44fbd84fe11923f2544bf4ba894240e2d6b5"} Jul 16 03:45:28.588620 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:28.588601 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd9rj" event={"ID":"c5680e09-96d8-4144-b374-ef7e690a4429","Type":"ContainerStarted","Data":"b4fb851e37af5edddac2edc49d73ad617c10cc0ca6e5513222cdc281efdb2d64"} Jul 16 03:45:29.653832 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.653259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:29.653832 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.653320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:29.658101 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.658067 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"image-registry-7f69557788-tffcj\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:29.658472 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.658449 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d20f6bc8-3cf6-4ad9-85b1-a51699273a26-metrics-tls\") pod \"dns-default-rhqzt\" (UID: \"d20f6bc8-3cf6-4ad9-85b1-a51699273a26\") " pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:29.840395 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.840363 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xzf5d\"" Jul 16 03:45:29.846574 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.846547 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:29.848874 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.848853 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgpfk\"" Jul 16 03:45:29.855440 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.855357 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:29.961648 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.960818 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v"] Jul 16 03:45:29.981383 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.981327 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2"] Jul 16 03:45:29.981555 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.981450 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:29.985524 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.985498 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 03:45:29.986388 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.985997 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 03:45:29.986388 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.986061 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 03:45:29.986388 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.986303 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n4rct\"" Jul 16 03:45:29.987169 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.986948 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 03:45:29.999540 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.999514 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:45:29.999639 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.999563 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v"] Jul 16 03:45:29.999764 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:29.999656 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.000935 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.000879 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2"] Jul 16 03:45:30.003414 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.003392 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 03:45:30.056640 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.056571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a421f63b-699d-4200-8704-01e2f3f70a30-tmp\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.056872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.056662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgd7\" (UniqueName: \"kubernetes.io/projected/a421f63b-699d-4200-8704-01e2f3f70a30-kube-api-access-9bgd7\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.056872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.056701 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpm4\" (UniqueName: \"kubernetes.io/projected/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-kube-api-access-blpm4\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.056872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.056745 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.056872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.056780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a421f63b-699d-4200-8704-01e2f3f70a30-klusterlet-config\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.157406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a421f63b-699d-4200-8704-01e2f3f70a30-klusterlet-config\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.157470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a421f63b-699d-4200-8704-01e2f3f70a30-tmp\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.157505 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgd7\" (UniqueName: \"kubernetes.io/projected/a421f63b-699d-4200-8704-01e2f3f70a30-kube-api-access-9bgd7\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.157536 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpm4\" (UniqueName: \"kubernetes.io/projected/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-kube-api-access-blpm4\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.157581 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.161642 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.158387 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a421f63b-699d-4200-8704-01e2f3f70a30-tmp\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.164089 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.162819 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.164774 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.164749 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a421f63b-699d-4200-8704-01e2f3f70a30-klusterlet-config\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.177221 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.177195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpm4\" (UniqueName: \"kubernetes.io/projected/eedbea24-002e-4aa1-ba9a-d95d6f8cb226-kube-api-access-blpm4\") pod \"managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v\" (UID: \"eedbea24-002e-4aa1-ba9a-d95d6f8cb226\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.196025 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.195436 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgd7\" (UniqueName: \"kubernetes.io/projected/a421f63b-699d-4200-8704-01e2f3f70a30-kube-api-access-9bgd7\") pod \"klusterlet-addon-workmgr-69ff94dd65-krjx2\" (UID: \"a421f63b-699d-4200-8704-01e2f3f70a30\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.289322 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.289143 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rhqzt"] Jul 16 03:45:30.308384 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.308319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" Jul 16 03:45:30.317903 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.317876 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:30.319531 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.319475 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:45:30.479814 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:30.479705 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20f6bc8_3cf6_4ad9_85b1_a51699273a26.slice/crio-f10f85b4c112b2a93460421fd4bbf06994ebc3b9181a91998315e78d30b4af9d WatchSource:0}: Error finding container f10f85b4c112b2a93460421fd4bbf06994ebc3b9181a91998315e78d30b4af9d: Status 404 returned error can't find the container with id f10f85b4c112b2a93460421fd4bbf06994ebc3b9181a91998315e78d30b4af9d Jul 16 03:45:30.480207 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:30.480106 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba71435c_0a4a_40db_9aed_e3c9e9b7c5b7.slice/crio-9768b81414afd47fe9a7d5570f8c4630ebbe265708717a4aa1bcb8958b370a12 WatchSource:0}: Error finding container 9768b81414afd47fe9a7d5570f8c4630ebbe265708717a4aa1bcb8958b370a12: Status 404 returned error can't find the container with id 9768b81414afd47fe9a7d5570f8c4630ebbe265708717a4aa1bcb8958b370a12 Jul 16 03:45:30.598163 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.598112 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f69557788-tffcj" event={"ID":"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7","Type":"ContainerStarted","Data":"9768b81414afd47fe9a7d5570f8c4630ebbe265708717a4aa1bcb8958b370a12"} Jul 16 03:45:30.600009 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:30.599975 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhqzt" event={"ID":"d20f6bc8-3cf6-4ad9-85b1-a51699273a26","Type":"ContainerStarted","Data":"f10f85b4c112b2a93460421fd4bbf06994ebc3b9181a91998315e78d30b4af9d"} Jul 16 03:45:33.624029 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.623951 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:45:33.632669 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.632645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.636310 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636061 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 03:45:33.636688 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636629 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 03:45:33.636688 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636647 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 03:45:33.636873 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636730 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:45:33.636873 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636752 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 03:45:33.636873 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636791 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 03:45:33.637029 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.636900 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 03:45:33.637105 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.637087 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-llzpk\"" Jul 16 03:45:33.637176 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.637145 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 03:45:33.687808 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.687808 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.688006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.688006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687934 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.688006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlgr6\" (UniqueName: \"kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.688006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.687995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788810 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788992 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788992 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788992 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788911 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788992 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlgr6\" (UniqueName: \"kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.788992 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.788966 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.789663 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.789615 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.789938 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.789894 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.789938 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.789928 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.791604 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.791585 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.791849 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.791828 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.797252 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.797225 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlgr6\" (UniqueName: \"kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6\") pod \"console-68488bdffc-7p9cw\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:33.945210 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:33.945174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:35.336454 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:35.336233 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v"] Jul 16 03:45:35.674768 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:35.674740 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeedbea24_002e_4aa1_ba9a_d95d6f8cb226.slice/crio-9f55815ed5d4aeec00f37292a99c61b5478b754374b08062209c87c22f7866db WatchSource:0}: Error finding container 9f55815ed5d4aeec00f37292a99c61b5478b754374b08062209c87c22f7866db: Status 404 returned error can't find the container with id 9f55815ed5d4aeec00f37292a99c61b5478b754374b08062209c87c22f7866db Jul 16 03:45:35.875226 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:35.875052 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2"] Jul 16 03:45:35.881262 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:35.880768 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda421f63b_699d_4200_8704_01e2f3f70a30.slice/crio-294cbf717555d483916862feead0ba667fc787d82927386a7f8b96ca343e6c4c WatchSource:0}: Error finding container 294cbf717555d483916862feead0ba667fc787d82927386a7f8b96ca343e6c4c: Status 404 returned error can't find the container with id 294cbf717555d483916862feead0ba667fc787d82927386a7f8b96ca343e6c4c Jul 16 03:45:35.897778 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:35.897593 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:45:35.904523 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:35.904486 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41673910_df48_494d_9c27_cc88f8c0dea3.slice/crio-713a5f79d64502e7fc3c264968021d72aec518a2750576cc44969dd713739f8f WatchSource:0}: Error finding container 713a5f79d64502e7fc3c264968021d72aec518a2750576cc44969dd713739f8f: Status 404 returned error can't find the container with id 713a5f79d64502e7fc3c264968021d72aec518a2750576cc44969dd713739f8f Jul 16 03:45:36.624237 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.624201 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd9rj" event={"ID":"c5680e09-96d8-4144-b374-ef7e690a4429","Type":"ContainerStarted","Data":"6ee95029666d85219a9c26347bec911e7aacb621f0c3959a675d6a92e5634ceb"} Jul 16 03:45:36.627422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.626688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnp89" event={"ID":"f7e59f04-007d-4330-8b22-03a5a854a984","Type":"ContainerStarted","Data":"9b53de43162611aaf97461a787bf954d3bab7fd4a9147bb44d7e2c38ca27d556"} Jul 16 03:45:36.627422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.627256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:45:36.631930 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.631876 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l7742" event={"ID":"e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8","Type":"ContainerStarted","Data":"315337b79281e35d4518d746de4ffbd2a957aa4b35448ecd64b4822f8339a273"} Jul 16 03:45:36.634932 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.634276 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhqzt" event={"ID":"d20f6bc8-3cf6-4ad9-85b1-a51699273a26","Type":"ContainerStarted","Data":"3f90e9e3de380b5ba644d0f11218e60a5ebcd66c5a7fe1dec1239d62325fc3ef"} Jul 16 03:45:36.634932 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.634321 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhqzt" event={"ID":"d20f6bc8-3cf6-4ad9-85b1-a51699273a26","Type":"ContainerStarted","Data":"bc545b506f59eb03d3d41f05166aa94d0e07ff04a7f27e0d2ffd4e5228d61d69"} Jul 16 03:45:36.635178 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.635144 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:36.636306 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.636250 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68488bdffc-7p9cw" event={"ID":"41673910-df48-494d-9c27-cc88f8c0dea3","Type":"ContainerStarted","Data":"713a5f79d64502e7fc3c264968021d72aec518a2750576cc44969dd713739f8f"} Jul 16 03:45:36.639397 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.638918 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4nkf" event={"ID":"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb","Type":"ContainerStarted","Data":"7758aaa3109c7d60ba9ed9ba5af36e90e769690c2914359978e8c9540134058e"} Jul 16 03:45:36.639397 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.638964 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4nkf" event={"ID":"6bfd1426-c9ef-4817-91c7-0a43f4ac3feb","Type":"ContainerStarted","Data":"9df17b208db6ada25c232fdccb3c5bc454475f5224f55281a989b63eaf8d1e70"} Jul 16 03:45:36.640929 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.640861 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" event={"ID":"a421f63b-699d-4200-8704-01e2f3f70a30","Type":"ContainerStarted","Data":"294cbf717555d483916862feead0ba667fc787d82927386a7f8b96ca343e6c4c"} Jul 16 03:45:36.642894 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.642785 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" event={"ID":"eedbea24-002e-4aa1-ba9a-d95d6f8cb226","Type":"ContainerStarted","Data":"9f55815ed5d4aeec00f37292a99c61b5478b754374b08062209c87c22f7866db"} Jul 16 03:45:36.646472 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.646425 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pnp89" podStartSLOduration=67.468506832 podStartE2EDuration="1m14.646407599s" totalImagesPullingTime="7.177900767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:36.643287735 +0000 UTC m=+74.762833214" watchObservedRunningTime="2026-07-16 03:45:36.646407599 +0000 UTC m=+74.765953030" Jul 16 03:45:36.657376 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.655961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f69557788-tffcj" event={"ID":"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7","Type":"ContainerStarted","Data":"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b"} Jul 16 03:45:36.657376 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.656221 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:36.666975 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.666906 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l7742" podStartSLOduration=67.472263112 podStartE2EDuration="1m14.666885319s" totalImagesPullingTime="7.194622207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:36.6658237 +0000 UTC m=+74.785369129" watchObservedRunningTime="2026-07-16 03:45:36.666885319 +0000 UTC m=+74.786430794" Jul 16 03:45:36.681478 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.681422 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w4nkf" podStartSLOduration=68.114125519 podStartE2EDuration="1m14.681404796s" totalImagesPullingTime="6.567279277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:36.680993328 +0000 UTC m=+74.800538763" watchObservedRunningTime="2026-07-16 03:45:36.681404796 +0000 UTC m=+74.800950228" Jul 16 03:45:36.703682 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.703632 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rhqzt" podStartSLOduration=34.45341018 podStartE2EDuration="39.703616853s" totalImagesPullingTime="5.250206673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:36.702946157 +0000 UTC m=+74.822491629" watchObservedRunningTime="2026-07-16 03:45:36.703616853 +0000 UTC m=+74.823162328" Jul 16 03:45:36.737681 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:36.737437 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f69557788-tffcj" podStartSLOduration=46.737414707 podStartE2EDuration="46.737414707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:36.736469465 +0000 UTC m=+74.856014893" watchObservedRunningTime="2026-07-16 03:45:36.737414707 +0000 UTC m=+74.856960137" Jul 16 03:45:37.986038 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:37.984957 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52"] Jul 16 03:45:37.994239 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:37.993974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:38.003309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.002905 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nqb49\"" Jul 16 03:45:38.003309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.003167 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 03:45:38.019145 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.019101 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52"] Jul 16 03:45:38.148129 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.148024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fff2bfd6-5703-4e97-82b9-419b9036ca00-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zlr52\" (UID: \"fff2bfd6-5703-4e97-82b9-419b9036ca00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:38.249305 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.249174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fff2bfd6-5703-4e97-82b9-419b9036ca00-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zlr52\" (UID: \"fff2bfd6-5703-4e97-82b9-419b9036ca00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:38.264713 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.261621 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fff2bfd6-5703-4e97-82b9-419b9036ca00-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zlr52\" (UID: \"fff2bfd6-5703-4e97-82b9-419b9036ca00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:38.307631 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:38.307597 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:40.617448 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.617420 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:45:40.622600 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.622577 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.635210 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.635143 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 03:45:40.635372 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.635214 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:45:40.769524 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769484 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769690 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769572 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769690 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmj6\" (UniqueName: \"kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769690 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769658 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.769859 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.769839 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.870798 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.870798 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870771 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.870941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmj6\" (UniqueName: \"kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871608 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.871582 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871718 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.871639 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.871926 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.871900 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.872116 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.872089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.873662 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.873620 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.873789 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.873765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.888064 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.888040 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmj6\" (UniqueName: \"kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6\") pod \"console-86d6b466c6-5vtwr\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:40.936042 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:40.936008 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:43.209633 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.209597 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:45:43.214225 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:43.214189 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266e863b_d983_408a_a2c0_befd0f5a50b0.slice/crio-6547a32309fe85e7d558dddf36260d79529cbad21633aa4463305cf390db13c4 WatchSource:0}: Error finding container 6547a32309fe85e7d558dddf36260d79529cbad21633aa4463305cf390db13c4: Status 404 returned error can't find the container with id 6547a32309fe85e7d558dddf36260d79529cbad21633aa4463305cf390db13c4 Jul 16 03:45:43.233003 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.232936 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52"] Jul 16 03:45:43.238625 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:43.238600 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff2bfd6_5703_4e97_82b9_419b9036ca00.slice/crio-25098c724e431286165554f63e1bc6cb395d7c3dca466201bca418671841d1d2 WatchSource:0}: Error finding container 25098c724e431286165554f63e1bc6cb395d7c3dca466201bca418671841d1d2: Status 404 returned error can't find the container with id 25098c724e431286165554f63e1bc6cb395d7c3dca466201bca418671841d1d2 Jul 16 03:45:43.684540 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.684495 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd9rj" event={"ID":"c5680e09-96d8-4144-b374-ef7e690a4429","Type":"ContainerStarted","Data":"c51f474359b1205ace2c2243e1aff108b0a05e0dfd3b41e55e975716345127f8"} Jul 16 03:45:43.686156 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.686127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68488bdffc-7p9cw" event={"ID":"41673910-df48-494d-9c27-cc88f8c0dea3","Type":"ContainerStarted","Data":"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c"} Jul 16 03:45:43.687363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.687324 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" event={"ID":"fff2bfd6-5703-4e97-82b9-419b9036ca00","Type":"ContainerStarted","Data":"25098c724e431286165554f63e1bc6cb395d7c3dca466201bca418671841d1d2"} Jul 16 03:45:43.688721 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.688699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" event={"ID":"a421f63b-699d-4200-8704-01e2f3f70a30","Type":"ContainerStarted","Data":"78e040d11fa057e510cd071f8c45ac4b693a69e5069e7530b853012620695998"} Jul 16 03:45:43.688842 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.688822 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:43.690096 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.690064 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" event={"ID":"eedbea24-002e-4aa1-ba9a-d95d6f8cb226","Type":"ContainerStarted","Data":"00c920d4352beb88c4d9a79b46d6bdf7131aac04f62abb0ffb3326f48201e7b5"} Jul 16 03:45:43.690732 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.690715 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" Jul 16 03:45:43.691554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.691536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6b466c6-5vtwr" event={"ID":"266e863b-d983-408a-a2c0-befd0f5a50b0","Type":"ContainerStarted","Data":"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9"} Jul 16 03:45:43.691629 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.691564 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6b466c6-5vtwr" event={"ID":"266e863b-d983-408a-a2c0-befd0f5a50b0","Type":"ContainerStarted","Data":"6547a32309fe85e7d558dddf36260d79529cbad21633aa4463305cf390db13c4"} Jul 16 03:45:43.702716 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.702675 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gd9rj" podStartSLOduration=17.334552707 podStartE2EDuration="36.702662316s" totalImagesPullingTime="19.368109609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:45:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:43.702227648 +0000 UTC m=+81.821773097" watchObservedRunningTime="2026-07-16 03:45:43.702662316 +0000 UTC m=+81.822207745" Jul 16 03:45:43.720151 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.720100 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d6b466c6-5vtwr" podStartSLOduration=3.72008846 podStartE2EDuration="3.72008846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:43.719058416 +0000 UTC m=+81.838603845" watchObservedRunningTime="2026-07-16 03:45:43.72008846 +0000 UTC m=+81.839633866" Jul 16 03:45:43.734183 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.734148 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59b55fbd-lvw8v" podStartSLOduration=7.353445787 podStartE2EDuration="14.734136311s" totalImagesPullingTime="7.380690524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:43.733144165 +0000 UTC m=+81.852689605" watchObservedRunningTime="2026-07-16 03:45:43.734136311 +0000 UTC m=+81.853681741" Jul 16 03:45:43.752050 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.752013 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68488bdffc-7p9cw" podStartSLOduration=3.5990407639999997 podStartE2EDuration="10.752002381s" totalImagesPullingTime="7.152961617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:43.751043417 +0000 UTC m=+81.870588848" watchObservedRunningTime="2026-07-16 03:45:43.752002381 +0000 UTC m=+81.871547812" Jul 16 03:45:43.765467 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.765433 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69ff94dd65-krjx2" podStartSLOduration=7.564204886 podStartE2EDuration="14.765421474s" totalImagesPullingTime="7.201216588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:43.765128189 +0000 UTC m=+81.884673644" watchObservedRunningTime="2026-07-16 03:45:43.765421474 +0000 UTC m=+81.884966902" Jul 16 03:45:43.945858 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.945773 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:43.945858 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.945849 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:43.950835 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:43.950812 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:44.699066 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:44.699031 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" event={"ID":"fff2bfd6-5703-4e97-82b9-419b9036ca00","Type":"ContainerStarted","Data":"38f907b5d7ec216565a56e52e8989adb1044b2f036e0369aefeebd5d7edc4ffa"} Jul 16 03:45:44.699983 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:44.699963 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:44.703933 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:44.703910 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:45:44.704572 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:44.704548 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" Jul 16 03:45:44.716448 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:44.716413 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zlr52" podStartSLOduration=6.624972217 podStartE2EDuration="7.716400082s" totalImagesPullingTime="1.091427865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:44.715781908 +0000 UTC m=+82.835327336" watchObservedRunningTime="2026-07-16 03:45:44.716400082 +0000 UTC m=+82.835945510" Jul 16 03:45:45.041194 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.041119 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-744cd"] Jul 16 03:45:45.043192 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.043176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.045785 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.045757 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 03:45:45.045785 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.045774 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 03:45:45.046004 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.045866 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 03:45:45.046707 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.046686 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fl84c\"" Jul 16 03:45:45.046777 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.046726 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 03:45:45.046777 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.046690 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 03:45:45.054013 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.053993 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-744cd"] Jul 16 03:45:45.208619 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.208589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce3f495-f435-4e4b-9f98-42a36bd432a2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.208780 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.208625 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.208780 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.208691 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.208780 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.208734 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpls\" (UniqueName: \"kubernetes.io/projected/1ce3f495-f435-4e4b-9f98-42a36bd432a2-kube-api-access-kbpls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.309986 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.309908 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce3f495-f435-4e4b-9f98-42a36bd432a2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.309986 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.309945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.309986 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.309971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.310169 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.309993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpls\" (UniqueName: \"kubernetes.io/projected/1ce3f495-f435-4e4b-9f98-42a36bd432a2-kube-api-access-kbpls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.310735 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.310705 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce3f495-f435-4e4b-9f98-42a36bd432a2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.312261 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.312232 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.312373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.312322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce3f495-f435-4e4b-9f98-42a36bd432a2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.317843 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.317820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpls\" (UniqueName: \"kubernetes.io/projected/1ce3f495-f435-4e4b-9f98-42a36bd432a2-kube-api-access-kbpls\") pod \"prometheus-operator-64785b6675-744cd\" (UID: \"1ce3f495-f435-4e4b-9f98-42a36bd432a2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.351758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.351736 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" Jul 16 03:45:45.472560 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.472489 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-744cd"] Jul 16 03:45:45.475039 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:45.475008 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce3f495_f435_4e4b_9f98_42a36bd432a2.slice/crio-33d17df8979b19f01281d01deefc2a829e6ee746eb05719f9ea09db5bb681bc2 WatchSource:0}: Error finding container 33d17df8979b19f01281d01deefc2a829e6ee746eb05719f9ea09db5bb681bc2: Status 404 returned error can't find the container with id 33d17df8979b19f01281d01deefc2a829e6ee746eb05719f9ea09db5bb681bc2 Jul 16 03:45:45.703851 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:45.703812 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" event={"ID":"1ce3f495-f435-4e4b-9f98-42a36bd432a2","Type":"ContainerStarted","Data":"33d17df8979b19f01281d01deefc2a829e6ee746eb05719f9ea09db5bb681bc2"} Jul 16 03:45:47.667971 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:47.667944 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rhqzt" Jul 16 03:45:47.712384 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:47.712345 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" event={"ID":"1ce3f495-f435-4e4b-9f98-42a36bd432a2","Type":"ContainerStarted","Data":"fe219255935f4eeb6151acef7725928f5cda117aae0ac2800ae26d9245aaa703"} Jul 16 03:45:47.712584 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:47.712412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" event={"ID":"1ce3f495-f435-4e4b-9f98-42a36bd432a2","Type":"ContainerStarted","Data":"0d7b8cad7d0a22fba70a0d0da6f3236266f65e6793109cd2740be190d553d57c"} Jul 16 03:45:47.732315 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:47.731985 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-744cd" podStartSLOduration=1.5011050209999999 podStartE2EDuration="2.731966725s" totalImagesPullingTime="1.230861704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:47.731479586 +0000 UTC m=+85.851025040" watchObservedRunningTime="2026-07-16 03:45:47.731966725 +0000 UTC m=+85.851512155" Jul 16 03:45:49.445914 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.445881 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dswrh"] Jul 16 03:45:49.449809 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.449788 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.452190 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.452171 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 03:45:49.452707 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.452689 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 03:45:49.452802 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.452777 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 03:45:49.452861 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.452689 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jgb64\"" Jul 16 03:45:49.544557 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-root\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544724 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544572 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktn9\" (UniqueName: \"kubernetes.io/projected/45108891-4a6d-4648-9fca-17347347cbdd-kube-api-access-cktn9\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544724 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-sys\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544724 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544700 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544886 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-wtmp\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544886 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-tls\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.544886 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-metrics-client-ca\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.545024 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-textfile\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.545024 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.544930 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645771 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645732 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-textfile\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645785 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645817 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-root\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktn9\" (UniqueName: \"kubernetes.io/projected/45108891-4a6d-4648-9fca-17347347cbdd-kube-api-access-cktn9\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645877 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-sys\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645914 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645921 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-root\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.645949 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-wtmp\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645965 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-sys\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.645999 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-tls\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.646034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-metrics-client-ca\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.646074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-wtmp\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646257 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.646123 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-textfile\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646494 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.646438 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.646570 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.646551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45108891-4a6d-4648-9fca-17347347cbdd-metrics-client-ca\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.648307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.648282 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.648421 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.648400 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45108891-4a6d-4648-9fca-17347347cbdd-node-exporter-tls\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.657085 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.657061 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktn9\" (UniqueName: \"kubernetes.io/projected/45108891-4a6d-4648-9fca-17347347cbdd-kube-api-access-cktn9\") pod \"node-exporter-dswrh\" (UID: \"45108891-4a6d-4648-9fca-17347347cbdd\") " pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.760254 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:49.760170 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dswrh" Jul 16 03:45:49.773381 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:49.773352 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45108891_4a6d_4648_9fca_17347347cbdd.slice/crio-a9a15fde9ad333db9ad283022e92293ead1e383a4b3efc8cb341f8cc82186f29 WatchSource:0}: Error finding container a9a15fde9ad333db9ad283022e92293ead1e383a4b3efc8cb341f8cc82186f29: Status 404 returned error can't find the container with id a9a15fde9ad333db9ad283022e92293ead1e383a4b3efc8cb341f8cc82186f29 Jul 16 03:45:50.726266 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.726239 2583 generic.go:356] "Generic (PLEG): container finished" podID="45108891-4a6d-4648-9fca-17347347cbdd" containerID="355b68ca0b75056f05f73597c2870fb71f98fedb2e1dbd752ff5f39ee357ee32" exitCode=0 Jul 16 03:45:50.726608 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.726297 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dswrh" event={"ID":"45108891-4a6d-4648-9fca-17347347cbdd","Type":"ContainerDied","Data":"355b68ca0b75056f05f73597c2870fb71f98fedb2e1dbd752ff5f39ee357ee32"} Jul 16 03:45:50.726608 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.726364 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dswrh" event={"ID":"45108891-4a6d-4648-9fca-17347347cbdd","Type":"ContainerStarted","Data":"a9a15fde9ad333db9ad283022e92293ead1e383a4b3efc8cb341f8cc82186f29"} Jul 16 03:45:50.936355 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.936312 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:50.936523 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.936414 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:50.941045 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:50.941021 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:51.731872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:51.731832 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dswrh" event={"ID":"45108891-4a6d-4648-9fca-17347347cbdd","Type":"ContainerStarted","Data":"6bed5184cf561ed839d869b338f7acee58c0b5235888fdbe69b78eee90b32aa9"} Jul 16 03:45:51.732270 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:51.731898 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dswrh" event={"ID":"45108891-4a6d-4648-9fca-17347347cbdd","Type":"ContainerStarted","Data":"0165025fbbea89dd1018be1c2aa55f50435dccf1b7a7df3dc2b3a791c6ce05ef"} Jul 16 03:45:51.735834 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:51.735813 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:45:51.754319 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:51.754264 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dswrh" podStartSLOduration=1.8765929620000001 podStartE2EDuration="2.754240581s" totalImagesPullingTime="812.443823ms" totalInitContainerRuntime="65.203796ms" isStatefulPod=true podCreationTimestamp="2026-07-16 03:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:51.75130789 +0000 UTC m=+89.870853338" watchObservedRunningTime="2026-07-16 03:45:51.754240581 +0000 UTC m=+89.873786015" Jul 16 03:45:51.807322 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:51.807293 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:45:54.213584 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.213553 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf"] Jul 16 03:45:54.216724 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.216702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.219096 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.219073 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 03:45:54.219189 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.219126 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-84ndd\"" Jul 16 03:45:54.226845 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.226822 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf"] Jul 16 03:45:54.281401 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.281358 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9ft\" (UniqueName: \"kubernetes.io/projected/a5d5a5db-0331-481f-997a-a4e1019b1d72-kube-api-access-mt9ft\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.281544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.281407 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5d5a5db-0331-481f-997a-a4e1019b1d72-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.381961 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.381923 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5d5a5db-0331-481f-997a-a4e1019b1d72-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.382143 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.382009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9ft\" (UniqueName: \"kubernetes.io/projected/a5d5a5db-0331-481f-997a-a4e1019b1d72-kube-api-access-mt9ft\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.384253 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.384234 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5d5a5db-0331-481f-997a-a4e1019b1d72-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.390838 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.390815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9ft\" (UniqueName: \"kubernetes.io/projected/a5d5a5db-0331-481f-997a-a4e1019b1d72-kube-api-access-mt9ft\") pod \"monitoring-plugin-5f68df7f58-55bqf\" (UID: \"a5d5a5db-0331-481f-997a-a4e1019b1d72\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.526935 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.526850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:54.657802 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.657770 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf"] Jul 16 03:45:54.660217 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:54.660184 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d5a5db_0331_481f_997a_a4e1019b1d72.slice/crio-483117a66d5bf6b5b8afad529c716d4e6a33a2b67a69327bcae6f8666e3d2975 WatchSource:0}: Error finding container 483117a66d5bf6b5b8afad529c716d4e6a33a2b67a69327bcae6f8666e3d2975: Status 404 returned error can't find the container with id 483117a66d5bf6b5b8afad529c716d4e6a33a2b67a69327bcae6f8666e3d2975 Jul 16 03:45:54.743526 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:54.743490 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" event={"ID":"a5d5a5db-0331-481f-997a-a4e1019b1d72","Type":"ContainerStarted","Data":"483117a66d5bf6b5b8afad529c716d4e6a33a2b67a69327bcae6f8666e3d2975"} Jul 16 03:45:56.662433 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:56.662399 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:45:56.753075 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:56.753034 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" event={"ID":"a5d5a5db-0331-481f-997a-a4e1019b1d72","Type":"ContainerStarted","Data":"a99e97773d870c27e08e20bb89f2ded63d5387c7aff2f2bc5f6bfb92084d40fd"} Jul 16 03:45:56.753258 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:56.753199 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:56.757619 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:56.757596 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" Jul 16 03:45:56.768698 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:56.768651 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-55bqf" podStartSLOduration=1.223322827 podStartE2EDuration="2.768634641s" totalImagesPullingTime="1.545311814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:56.768076648 +0000 UTC m=+94.887622078" watchObservedRunningTime="2026-07-16 03:45:56.768634641 +0000 UTC m=+94.888180070" Jul 16 03:45:58.606406 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.606374 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:45:58.611847 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.611779 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.621707 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.621676 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:45:58.716139 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716102 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8nq\" (UniqueName: \"kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716139 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716176 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716219 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716363 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716361 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.716487 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.716382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816701 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816701 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816741 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8nq\" (UniqueName: \"kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.816953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.816884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.817570 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.817545 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.817680 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.817550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.817727 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.817672 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.817912 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.817893 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.819303 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.819287 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.819375 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.819313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.830074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.830054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8nq\" (UniqueName: \"kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq\") pod \"console-5b8445cfcd-5gsd9\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:58.926217 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:58.926182 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:45:59.081411 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:59.081379 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:45:59.084764 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:45:59.084734 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1040aa_5a6c_4d79_a121_3cfc62416db1.slice/crio-a2ce71f6d5e3ba38327bf790fcdc63f4d1c65a1c02aa32e2cdf67eca550f6dec WatchSource:0}: Error finding container a2ce71f6d5e3ba38327bf790fcdc63f4d1c65a1c02aa32e2cdf67eca550f6dec: Status 404 returned error can't find the container with id a2ce71f6d5e3ba38327bf790fcdc63f4d1c65a1c02aa32e2cdf67eca550f6dec Jul 16 03:45:59.765255 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:59.765218 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8445cfcd-5gsd9" event={"ID":"7d1040aa-5a6c-4d79-a121-3cfc62416db1","Type":"ContainerStarted","Data":"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8"} Jul 16 03:45:59.765712 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:59.765268 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8445cfcd-5gsd9" event={"ID":"7d1040aa-5a6c-4d79-a121-3cfc62416db1","Type":"ContainerStarted","Data":"a2ce71f6d5e3ba38327bf790fcdc63f4d1c65a1c02aa32e2cdf67eca550f6dec"} Jul 16 03:45:59.783931 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:45:59.783884 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8445cfcd-5gsd9" podStartSLOduration=1.78386977 podStartE2EDuration="1.78386977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:45:59.783203467 +0000 UTC m=+97.902748897" watchObservedRunningTime="2026-07-16 03:45:59.78386977 +0000 UTC m=+97.903415199" Jul 16 03:46:01.688523 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:01.688482 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f69557788-tffcj" podUID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" containerName="registry" containerID="cri-o://90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b" gracePeriod=30 Jul 16 03:46:02.478914 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.478888 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:46:02.549508 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549460 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549508 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549508 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxhnq\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549760 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549532 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549760 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549562 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549760 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549683 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549918 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549771 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549918 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549839 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.549918 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.549873 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration\") pod \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\" (UID: \"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7\") " Jul 16 03:46:02.550091 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.550063 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:02.550141 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.550114 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:02.554184 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.554132 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:02.554471 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.554442 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:02.554678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.554658 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:02.554678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.554663 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:02.554802 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.554774 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq" (OuterVolumeSpecName: "kube-api-access-lxhnq") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "kube-api-access-lxhnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:02.558966 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.558943 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" (UID: "ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 03:46:02.651113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651077 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-certificates\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651108 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxhnq\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-kube-api-access-lxhnq\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651113 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651121 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-registry-tls\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651130 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-trusted-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651139 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-bound-sa-token\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651147 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-installation-pull-secrets\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651156 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-ca-trust-extracted\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.651373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.651166 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7-image-registry-private-configuration\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:02.779204 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.779167 2583 generic.go:356] "Generic (PLEG): container finished" podID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" containerID="90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b" exitCode=0 Jul 16 03:46:02.779613 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.779219 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f69557788-tffcj" Jul 16 03:46:02.779613 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.779260 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f69557788-tffcj" event={"ID":"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7","Type":"ContainerDied","Data":"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b"} Jul 16 03:46:02.779613 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.779314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f69557788-tffcj" event={"ID":"ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7","Type":"ContainerDied","Data":"9768b81414afd47fe9a7d5570f8c4630ebbe265708717a4aa1bcb8958b370a12"} Jul 16 03:46:02.779613 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.779364 2583 scope.go:117] "RemoveContainer" containerID="90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b" Jul 16 03:46:02.788839 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.788812 2583 scope.go:117] "RemoveContainer" containerID="90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b" Jul 16 03:46:02.789126 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:46:02.789108 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b\": container with ID starting with 90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b not found: ID does not exist" containerID="90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b" Jul 16 03:46:02.789174 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.789135 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b"} err="failed to get container status \"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b\": rpc error: code = NotFound desc = could not find container \"90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b\": container with ID starting with 90e0352a599ef61211e7282bc4eaeb4f29e994064e29429474853fc6e518f02b not found: ID does not exist" Jul 16 03:46:02.804127 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.804095 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:46:02.808164 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:02.808134 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f69557788-tffcj"] Jul 16 03:46:03.570153 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.570117 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:46:03.601755 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.601724 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:46:03.602022 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.602003 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" containerName="registry" Jul 16 03:46:03.602092 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.602033 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" containerName="registry" Jul 16 03:46:03.602092 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.602083 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" containerName="registry" Jul 16 03:46:03.671465 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.671422 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:46:03.671649 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.671491 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.758905 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.758865 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.758905 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.758907 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.759104 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.758922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxhgd\" (UniqueName: \"kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.759104 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.759006 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.759104 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.759058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.759104 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.759099 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.759218 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.759117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860257 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxhgd\" (UniqueName: \"kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860297 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860321 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860948 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860948 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.860948 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.860476 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.861207 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.861185 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.861288 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.861221 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.861288 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.861259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.861510 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.861493 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.863243 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.863221 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.863357 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.863302 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.867384 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.867365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxhgd\" (UniqueName: \"kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd\") pod \"console-7d76dd7764-7rjvc\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:03.980666 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:03.980630 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:04.139736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:04.139704 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:46:04.332435 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:04.332403 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7" path="/var/lib/kubelet/pods/ba71435c-0a4a-40db-9aed-e3c9e9b7c5b7/volumes" Jul 16 03:46:04.788986 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:04.788944 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d76dd7764-7rjvc" event={"ID":"f6c141be-fac5-40e2-8ddb-ad78356afd27","Type":"ContainerStarted","Data":"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7"} Jul 16 03:46:04.789171 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:04.788998 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d76dd7764-7rjvc" event={"ID":"f6c141be-fac5-40e2-8ddb-ad78356afd27","Type":"ContainerStarted","Data":"57940c7d8900ff7e2befcb442175cc6f110ed8392bfa9f96edddb99e66048e16"} Jul 16 03:46:04.807745 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:04.807693 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d76dd7764-7rjvc" podStartSLOduration=1.807677378 podStartE2EDuration="1.807677378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:46:04.807162378 +0000 UTC m=+102.926707807" watchObservedRunningTime="2026-07-16 03:46:04.807677378 +0000 UTC m=+102.927222806" Jul 16 03:46:08.667752 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:08.667722 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pnp89" Jul 16 03:46:08.927222 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:08.927128 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:46:13.981286 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:13.981253 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:13.981861 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:13.981367 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:13.985719 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:13.985700 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:14.833306 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:14.833271 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:46:14.878037 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:14.878008 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:46:16.827448 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:16.827407 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68488bdffc-7p9cw" podUID="41673910-df48-494d-9c27-cc88f8c0dea3" containerName="console" containerID="cri-o://3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c" gracePeriod=15 Jul 16 03:46:17.109535 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.109474 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:46:17.175871 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.175840 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176011 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.175881 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176011 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.175907 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176092 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176060 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlgr6\" (UniqueName: \"kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176136 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176090 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176194 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176134 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca\") pod \"41673910-df48-494d-9c27-cc88f8c0dea3\" (UID: \"41673910-df48-494d-9c27-cc88f8c0dea3\") " Jul 16 03:46:17.176251 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176226 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:17.176305 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176261 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config" (OuterVolumeSpecName: "console-config") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:17.176554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176532 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-oauth-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.176554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176552 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-console-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.176554 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.176548 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca" (OuterVolumeSpecName: "service-ca") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:17.178219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.178195 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6" (OuterVolumeSpecName: "kube-api-access-nlgr6") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "kube-api-access-nlgr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:17.178219 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.178206 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:17.178372 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.178253 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41673910-df48-494d-9c27-cc88f8c0dea3" (UID: "41673910-df48-494d-9c27-cc88f8c0dea3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:17.277200 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.277162 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.277200 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.277192 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlgr6\" (UniqueName: \"kubernetes.io/projected/41673910-df48-494d-9c27-cc88f8c0dea3-kube-api-access-nlgr6\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.277200 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.277203 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41673910-df48-494d-9c27-cc88f8c0dea3-console-oauth-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.277200 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.277212 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41673910-df48-494d-9c27-cc88f8c0dea3-service-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:17.840436 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.840401 2583 generic.go:356] "Generic (PLEG): container finished" podID="41673910-df48-494d-9c27-cc88f8c0dea3" containerID="3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c" exitCode=0 Jul 16 03:46:17.840845 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.840449 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68488bdffc-7p9cw" Jul 16 03:46:17.840845 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.840465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68488bdffc-7p9cw" event={"ID":"41673910-df48-494d-9c27-cc88f8c0dea3","Type":"ContainerDied","Data":"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c"} Jul 16 03:46:17.840845 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.840506 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68488bdffc-7p9cw" event={"ID":"41673910-df48-494d-9c27-cc88f8c0dea3","Type":"ContainerDied","Data":"713a5f79d64502e7fc3c264968021d72aec518a2750576cc44969dd713739f8f"} Jul 16 03:46:17.840845 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.840526 2583 scope.go:117] "RemoveContainer" containerID="3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c" Jul 16 03:46:17.852420 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.852396 2583 scope.go:117] "RemoveContainer" containerID="3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c" Jul 16 03:46:17.852657 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:46:17.852640 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c\": container with ID starting with 3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c not found: ID does not exist" containerID="3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c" Jul 16 03:46:17.852736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.852664 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c"} err="failed to get container status \"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c\": rpc error: code = NotFound desc = could not find container \"3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c\": container with ID starting with 3efbb721537ca604abb24221ec91fb4fc51f944412beeac87b2bf7f817a1596c not found: ID does not exist" Jul 16 03:46:17.863748 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.863724 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:46:17.867421 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:17.867400 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68488bdffc-7p9cw"] Jul 16 03:46:18.328580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:18.328552 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41673910-df48-494d-9c27-cc88f8c0dea3" path="/var/lib/kubelet/pods/41673910-df48-494d-9c27-cc88f8c0dea3/volumes" Jul 16 03:46:22.529279 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:22.529199 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66gx8_d91c5d7b-b9af-41d9-a408-e488dba2d0c4/serve-healthcheck-canary/0.log" Jul 16 03:46:28.591070 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.591019 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b8445cfcd-5gsd9" podUID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" containerName="console" containerID="cri-o://180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8" gracePeriod=15 Jul 16 03:46:28.843433 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.843380 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:46:28.881869 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.881834 2583 generic.go:356] "Generic (PLEG): container finished" podID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" containerID="180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8" exitCode=0 Jul 16 03:46:28.882034 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.881888 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8445cfcd-5gsd9" Jul 16 03:46:28.882034 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.881929 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8445cfcd-5gsd9" event={"ID":"7d1040aa-5a6c-4d79-a121-3cfc62416db1","Type":"ContainerDied","Data":"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8"} Jul 16 03:46:28.882034 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.881986 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8445cfcd-5gsd9" event={"ID":"7d1040aa-5a6c-4d79-a121-3cfc62416db1","Type":"ContainerDied","Data":"a2ce71f6d5e3ba38327bf790fcdc63f4d1c65a1c02aa32e2cdf67eca550f6dec"} Jul 16 03:46:28.882034 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.882013 2583 scope.go:117] "RemoveContainer" containerID="180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8" Jul 16 03:46:28.889881 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.889866 2583 scope.go:117] "RemoveContainer" containerID="180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8" Jul 16 03:46:28.890109 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:46:28.890090 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8\": container with ID starting with 180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8 not found: ID does not exist" containerID="180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8" Jul 16 03:46:28.890154 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.890119 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8"} err="failed to get container status \"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8\": rpc error: code = NotFound desc = could not find container \"180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8\": container with ID starting with 180d89d90b1ae617d32f713179cc3c60c51a50a19c1cbb357790962cb3c14be8 not found: ID does not exist" Jul 16 03:46:28.970580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970548 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970728 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970590 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970728 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970609 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf8nq\" (UniqueName: \"kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970728 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970639 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970856 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970725 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970856 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970756 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.970856 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.970788 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config\") pod \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\" (UID: \"7d1040aa-5a6c-4d79-a121-3cfc62416db1\") " Jul 16 03:46:28.971073 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.971039 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:28.971192 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.971153 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:28.971192 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.971175 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config" (OuterVolumeSpecName: "console-config") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:28.971305 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.971187 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:28.972821 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.972792 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq" (OuterVolumeSpecName: "kube-api-access-hf8nq") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "kube-api-access-hf8nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:28.972920 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.972892 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:28.972964 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:28.972911 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d1040aa-5a6c-4d79-a121-3cfc62416db1" (UID: "7d1040aa-5a6c-4d79-a121-3cfc62416db1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:29.072072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072025 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072064 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-oauth-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072074 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-oauth-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072083 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1040aa-5a6c-4d79-a121-3cfc62416db1-console-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072092 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-service-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072382 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072101 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf8nq\" (UniqueName: \"kubernetes.io/projected/7d1040aa-5a6c-4d79-a121-3cfc62416db1-kube-api-access-hf8nq\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.072382 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.072109 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1040aa-5a6c-4d79-a121-3cfc62416db1-trusted-ca-bundle\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:29.204215 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.204188 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:46:29.210028 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:29.210008 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8445cfcd-5gsd9"] Jul 16 03:46:30.328799 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:30.328766 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" path="/var/lib/kubelet/pods/7d1040aa-5a6c-4d79-a121-3cfc62416db1/volumes" Jul 16 03:46:39.901044 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:39.900989 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d6b466c6-5vtwr" podUID="266e863b-d983-408a-a2c0-befd0f5a50b0" containerName="console" containerID="cri-o://e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9" gracePeriod=15 Jul 16 03:46:40.135166 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.135142 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:46:40.260097 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260017 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260097 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260055 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260296 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260179 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260296 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260219 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260296 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260253 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxmj6\" (UniqueName: \"kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260296 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260285 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260504 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260314 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca\") pod \"266e863b-d983-408a-a2c0-befd0f5a50b0\" (UID: \"266e863b-d983-408a-a2c0-befd0f5a50b0\") " Jul 16 03:46:40.260666 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260636 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:40.260756 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260583 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:40.260756 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260730 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config" (OuterVolumeSpecName: "console-config") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:40.260860 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.260827 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:46:40.262264 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.262237 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:40.262383 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.262272 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:46:40.262383 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.262320 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6" (OuterVolumeSpecName: "kube-api-access-hxmj6") pod "266e863b-d983-408a-a2c0-befd0f5a50b0" (UID: "266e863b-d983-408a-a2c0-befd0f5a50b0"). InnerVolumeSpecName "kube-api-access-hxmj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:46:40.361454 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361423 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-oauth-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361454 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361450 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-trusted-ca-bundle\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361462 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxmj6\" (UniqueName: \"kubernetes.io/projected/266e863b-d983-408a-a2c0-befd0f5a50b0-kube-api-access-hxmj6\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361475 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-console-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361488 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/266e863b-d983-408a-a2c0-befd0f5a50b0-service-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361498 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-oauth-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.361636 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.361510 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/266e863b-d983-408a-a2c0-befd0f5a50b0-console-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:46:40.928505 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.928469 2583 generic.go:356] "Generic (PLEG): container finished" podID="266e863b-d983-408a-a2c0-befd0f5a50b0" containerID="e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9" exitCode=0 Jul 16 03:46:40.928505 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.928509 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6b466c6-5vtwr" event={"ID":"266e863b-d983-408a-a2c0-befd0f5a50b0","Type":"ContainerDied","Data":"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9"} Jul 16 03:46:40.928970 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.928554 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6b466c6-5vtwr" event={"ID":"266e863b-d983-408a-a2c0-befd0f5a50b0","Type":"ContainerDied","Data":"6547a32309fe85e7d558dddf36260d79529cbad21633aa4463305cf390db13c4"} Jul 16 03:46:40.928970 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.928515 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6b466c6-5vtwr" Jul 16 03:46:40.928970 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.928581 2583 scope.go:117] "RemoveContainer" containerID="e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9" Jul 16 03:46:40.938582 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.938563 2583 scope.go:117] "RemoveContainer" containerID="e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9" Jul 16 03:46:40.938838 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:46:40.938813 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9\": container with ID starting with e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9 not found: ID does not exist" containerID="e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9" Jul 16 03:46:40.938881 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.938849 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9"} err="failed to get container status \"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9\": rpc error: code = NotFound desc = could not find container \"e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9\": container with ID starting with e9a93367e67713b8c2feca05d587ac219601e946d648565a1e396010214804a9 not found: ID does not exist" Jul 16 03:46:40.944973 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.944952 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:46:40.949186 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:40.949168 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d6b466c6-5vtwr"] Jul 16 03:46:42.328622 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:46:42.328595 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="266e863b-d983-408a-a2c0-befd0f5a50b0" path="/var/lib/kubelet/pods/266e863b-d983-408a-a2c0-befd0f5a50b0/volumes" Jul 16 03:47:23.959734 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959701 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959941 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41673910-df48-494d-9c27-cc88f8c0dea3" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959952 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="41673910-df48-494d-9c27-cc88f8c0dea3" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959963 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959968 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959977 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266e863b-d983-408a-a2c0-befd0f5a50b0" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.959982 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="266e863b-d983-408a-a2c0-befd0f5a50b0" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.960026 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="41673910-df48-494d-9c27-cc88f8c0dea3" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.960034 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="266e863b-d983-408a-a2c0-befd0f5a50b0" containerName="console" Jul 16 03:47:23.960115 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.960040 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d1040aa-5a6c-4d79-a121-3cfc62416db1" containerName="console" Jul 16 03:47:23.964017 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.963996 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:23.971865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:23.971840 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:47:24.066238 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066198 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxc2l\" (UniqueName: \"kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066312 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.066450 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.066442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167261 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167309 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167307 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxc2l\" (UniqueName: \"kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167580 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.167758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.167582 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.168173 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.168148 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.168292 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.168218 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.168292 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.168231 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.168292 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.168253 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.169892 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.169871 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.170014 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.169994 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.175924 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.175906 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxc2l\" (UniqueName: \"kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l\") pod \"console-98d6ccf4f-v6xd8\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.273153 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.273061 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:24.400054 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:24.400020 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:47:24.402985 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:47:24.402960 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06df040_a03c_4885_b150_aab222a06434.slice/crio-3afaa618ec920690370446fdd56bbdcfd9384a9c34c98cb5ab3351b23f8f7563 WatchSource:0}: Error finding container 3afaa618ec920690370446fdd56bbdcfd9384a9c34c98cb5ab3351b23f8f7563: Status 404 returned error can't find the container with id 3afaa618ec920690370446fdd56bbdcfd9384a9c34c98cb5ab3351b23f8f7563 Jul 16 03:47:25.085492 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:25.085458 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98d6ccf4f-v6xd8" event={"ID":"d06df040-a03c-4885-b150-aab222a06434","Type":"ContainerStarted","Data":"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12"} Jul 16 03:47:25.085919 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:25.085506 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98d6ccf4f-v6xd8" event={"ID":"d06df040-a03c-4885-b150-aab222a06434","Type":"ContainerStarted","Data":"3afaa618ec920690370446fdd56bbdcfd9384a9c34c98cb5ab3351b23f8f7563"} Jul 16 03:47:25.110476 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:25.110406 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98d6ccf4f-v6xd8" podStartSLOduration=2.110392028 podStartE2EDuration="2.110392028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:47:25.108817401 +0000 UTC m=+183.228362831" watchObservedRunningTime="2026-07-16 03:47:25.110392028 +0000 UTC m=+183.229937527" Jul 16 03:47:34.273994 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:34.273958 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:34.274553 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:34.274297 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:34.278985 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:34.278963 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:35.123307 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:35.123281 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:47:35.168516 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:47:35.168485 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:48:00.188440 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.188398 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d76dd7764-7rjvc" podUID="f6c141be-fac5-40e2-8ddb-ad78356afd27" containerName="console" containerID="cri-o://fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7" gracePeriod=15 Jul 16 03:48:00.432553 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.432528 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:48:00.435548 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435530 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxhgd\" (UniqueName: \"kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435637 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435585 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435637 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435616 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435731 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435635 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435731 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435661 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435731 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435679 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.435731 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.435713 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config\") pod \"f6c141be-fac5-40e2-8ddb-ad78356afd27\" (UID: \"f6c141be-fac5-40e2-8ddb-ad78356afd27\") " Jul 16 03:48:00.436220 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.436144 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:48:00.436220 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.436176 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:48:00.436220 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.436160 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config" (OuterVolumeSpecName: "console-config") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:48:00.436220 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.436206 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:48:00.437758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.437736 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:48:00.437758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.437750 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:48:00.437871 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.437755 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd" (OuterVolumeSpecName: "kube-api-access-dxhgd") pod "f6c141be-fac5-40e2-8ddb-ad78356afd27" (UID: "f6c141be-fac5-40e2-8ddb-ad78356afd27"). InnerVolumeSpecName "kube-api-access-dxhgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:48:00.536311 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536278 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxhgd\" (UniqueName: \"kubernetes.io/projected/f6c141be-fac5-40e2-8ddb-ad78356afd27-kube-api-access-dxhgd\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536311 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536307 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-oauth-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536311 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536316 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-oauth-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536325 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-service-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536354 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536362 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-trusted-ca-bundle\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:00.536544 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:00.536371 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6c141be-fac5-40e2-8ddb-ad78356afd27-console-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:48:01.208732 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.208697 2583 generic.go:356] "Generic (PLEG): container finished" podID="f6c141be-fac5-40e2-8ddb-ad78356afd27" containerID="fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7" exitCode=0 Jul 16 03:48:01.209182 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.208744 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d76dd7764-7rjvc" Jul 16 03:48:01.209182 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.208765 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d76dd7764-7rjvc" event={"ID":"f6c141be-fac5-40e2-8ddb-ad78356afd27","Type":"ContainerDied","Data":"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7"} Jul 16 03:48:01.209182 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.208852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d76dd7764-7rjvc" event={"ID":"f6c141be-fac5-40e2-8ddb-ad78356afd27","Type":"ContainerDied","Data":"57940c7d8900ff7e2befcb442175cc6f110ed8392bfa9f96edddb99e66048e16"} Jul 16 03:48:01.209182 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.208884 2583 scope.go:117] "RemoveContainer" containerID="fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7" Jul 16 03:48:01.218011 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.217989 2583 scope.go:117] "RemoveContainer" containerID="fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7" Jul 16 03:48:01.218300 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:48:01.218282 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7\": container with ID starting with fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7 not found: ID does not exist" containerID="fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7" Jul 16 03:48:01.218366 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.218308 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7"} err="failed to get container status \"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7\": rpc error: code = NotFound desc = could not find container \"fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7\": container with ID starting with fa6bb28f85a80a8daadddb9eb221e002bb1fcf8fa950de4d0ac0131027ea46e7 not found: ID does not exist" Jul 16 03:48:01.231169 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.231147 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:48:01.237152 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:01.237130 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d76dd7764-7rjvc"] Jul 16 03:48:02.329140 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:02.329102 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6c141be-fac5-40e2-8ddb-ad78356afd27" path="/var/lib/kubelet/pods/f6c141be-fac5-40e2-8ddb-ad78356afd27/volumes" Jul 16 03:48:28.085963 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.085928 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck"] Jul 16 03:48:28.086402 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.086171 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6c141be-fac5-40e2-8ddb-ad78356afd27" containerName="console" Jul 16 03:48:28.086402 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.086181 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6c141be-fac5-40e2-8ddb-ad78356afd27" containerName="console" Jul 16 03:48:28.086402 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.086227 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6c141be-fac5-40e2-8ddb-ad78356afd27" containerName="console" Jul 16 03:48:28.090023 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.089995 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.092621 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.092596 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 03:48:28.092736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.092604 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jr467\"" Jul 16 03:48:28.092736 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.092656 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 03:48:28.102913 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.102889 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck"] Jul 16 03:48:28.118790 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.118766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47srw\" (UniqueName: \"kubernetes.io/projected/553bc333-c32e-465f-a3ba-e3ae5eb963e4-kube-api-access-47srw\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.118905 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.118817 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553bc333-c32e-465f-a3ba-e3ae5eb963e4-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.219655 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.219618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47srw\" (UniqueName: \"kubernetes.io/projected/553bc333-c32e-465f-a3ba-e3ae5eb963e4-kube-api-access-47srw\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.219840 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.219664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553bc333-c32e-465f-a3ba-e3ae5eb963e4-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.219985 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.219968 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553bc333-c32e-465f-a3ba-e3ae5eb963e4-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.228296 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.228272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47srw\" (UniqueName: \"kubernetes.io/projected/553bc333-c32e-465f-a3ba-e3ae5eb963e4-kube-api-access-47srw\") pod \"cert-manager-operator-controller-manager-56b4598547-5dbck\" (UID: \"553bc333-c32e-465f-a3ba-e3ae5eb963e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.398677 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.398649 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" Jul 16 03:48:28.524047 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:28.524017 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck"] Jul 16 03:48:28.527382 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:48:28.527355 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553bc333_c32e_465f_a3ba_e3ae5eb963e4.slice/crio-d23597515483f5c1b30d82f15eacf8d201589407a945b5f6d0579861f1c73923 WatchSource:0}: Error finding container d23597515483f5c1b30d82f15eacf8d201589407a945b5f6d0579861f1c73923: Status 404 returned error can't find the container with id d23597515483f5c1b30d82f15eacf8d201589407a945b5f6d0579861f1c73923 Jul 16 03:48:29.305240 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:29.305200 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" event={"ID":"553bc333-c32e-465f-a3ba-e3ae5eb963e4","Type":"ContainerStarted","Data":"d23597515483f5c1b30d82f15eacf8d201589407a945b5f6d0579861f1c73923"} Jul 16 03:48:31.314954 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:31.314852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" event={"ID":"553bc333-c32e-465f-a3ba-e3ae5eb963e4","Type":"ContainerStarted","Data":"e4b39bf648b7bbcfdc11d1aee67e6d2d9a86624bc489b716b930901348f96a8e"} Jul 16 03:48:31.338129 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:31.338074 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-5dbck" podStartSLOduration=0.985600571 podStartE2EDuration="3.338060387s" totalImagesPullingTime="2.352459816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:48:31.336549451 +0000 UTC m=+249.456094892" watchObservedRunningTime="2026-07-16 03:48:31.338060387 +0000 UTC m=+249.457605816" Jul 16 03:48:34.558190 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.558155 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6"] Jul 16 03:48:34.561319 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.561303 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.563885 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.563867 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 03:48:34.563990 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.563943 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lrn88\"" Jul 16 03:48:34.564836 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.564816 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 03:48:34.572209 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.572191 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6"] Jul 16 03:48:34.669494 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.669461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2zdg\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-kube-api-access-n2zdg\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.669656 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.669504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.770380 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.770320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2zdg\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-kube-api-access-n2zdg\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.770537 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.770396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.780151 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.780120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.780251 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.780211 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2zdg\" (UniqueName: \"kubernetes.io/projected/d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9-kube-api-access-n2zdg\") pod \"cert-manager-cainjector-559cdd8c87-k7nv6\" (UID: \"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.869713 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.869645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" Jul 16 03:48:34.997876 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:34.997804 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6"] Jul 16 03:48:34.999970 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:48:34.999945 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4e7720b_dc05_467e_bdbc_e20fd9cf6ec9.slice/crio-103986efb6460cae458cf350821b079b4a9f7b6bf12bd8aca5bc344fb4f28f68 WatchSource:0}: Error finding container 103986efb6460cae458cf350821b079b4a9f7b6bf12bd8aca5bc344fb4f28f68: Status 404 returned error can't find the container with id 103986efb6460cae458cf350821b079b4a9f7b6bf12bd8aca5bc344fb4f28f68 Jul 16 03:48:35.329472 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:35.329434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" event={"ID":"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9","Type":"ContainerStarted","Data":"103986efb6460cae458cf350821b079b4a9f7b6bf12bd8aca5bc344fb4f28f68"} Jul 16 03:48:38.344008 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:38.343969 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" event={"ID":"d4e7720b-dc05-467e-bdbc-e20fd9cf6ec9","Type":"ContainerStarted","Data":"7917e1f7ab2aa2de095cb978ef4f2fea5e319ef7e205a4e91babfa968b70a415"} Jul 16 03:48:38.361247 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:38.361200 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-k7nv6" podStartSLOduration=1.817925096 podStartE2EDuration="4.361186389s" totalImagesPullingTime="2.543261293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:48:38.360195048 +0000 UTC m=+256.479740476" watchObservedRunningTime="2026-07-16 03:48:38.361186389 +0000 UTC m=+256.480731818" Jul 16 03:48:42.935809 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:42.935779 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-95sn2"] Jul 16 03:48:42.938923 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:42.938907 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:42.941155 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:42.941135 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7h57n\"" Jul 16 03:48:42.946463 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:42.946442 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-95sn2"] Jul 16 03:48:43.034365 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.034301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.034539 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.034385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm7vb\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-kube-api-access-cm7vb\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.135351 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.135307 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm7vb\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-kube-api-access-cm7vb\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.135505 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.135384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.144120 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.144099 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.144391 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.144372 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm7vb\" (UniqueName: \"kubernetes.io/projected/8d545228-c1dd-4401-8fe3-03406da40b8a-kube-api-access-cm7vb\") pod \"cert-manager-55b4d954d5-95sn2\" (UID: \"8d545228-c1dd-4401-8fe3-03406da40b8a\") " pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.248359 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.248257 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-95sn2" Jul 16 03:48:43.371971 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:43.371947 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-95sn2"] Jul 16 03:48:43.374498 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:48:43.374462 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d545228_c1dd_4401_8fe3_03406da40b8a.slice/crio-a4c8503bb17e2673938e1514c392eb4c32974e42f5f925115cc2fe0f380b66ce WatchSource:0}: Error finding container a4c8503bb17e2673938e1514c392eb4c32974e42f5f925115cc2fe0f380b66ce: Status 404 returned error can't find the container with id a4c8503bb17e2673938e1514c392eb4c32974e42f5f925115cc2fe0f380b66ce Jul 16 03:48:44.366678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:44.366600 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-95sn2" event={"ID":"8d545228-c1dd-4401-8fe3-03406da40b8a","Type":"ContainerStarted","Data":"055373d8c05461068c693b4ad4aa53e4cd449ebe729e70df2866044ea0fd4e1b"} Jul 16 03:48:44.366678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:44.366641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-95sn2" event={"ID":"8d545228-c1dd-4401-8fe3-03406da40b8a","Type":"ContainerStarted","Data":"a4c8503bb17e2673938e1514c392eb4c32974e42f5f925115cc2fe0f380b66ce"} Jul 16 03:48:44.384120 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:44.384075 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-95sn2" podStartSLOduration=2.384059321 podStartE2EDuration="2.384059321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:48:44.383102609 +0000 UTC m=+262.502648061" watchObservedRunningTime="2026-07-16 03:48:44.384059321 +0000 UTC m=+262.503604749" Jul 16 03:48:58.174181 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.174145 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-78mtp"] Jul 16 03:48:58.177319 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.177300 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.180054 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.180034 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-fjpkb\"" Jul 16 03:48:58.180148 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.180037 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 16 03:48:58.180758 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.180741 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 16 03:48:58.187784 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.187763 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-78mtp"] Jul 16 03:48:58.246242 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.246214 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhgs\" (UniqueName: \"kubernetes.io/projected/50fbcccc-e019-40a3-9d93-e03a1867a342-kube-api-access-pbhgs\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.246415 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.246269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fbcccc-e019-40a3-9d93-e03a1867a342-tmp\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.347329 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.347303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fbcccc-e019-40a3-9d93-e03a1867a342-tmp\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.347480 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.347369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhgs\" (UniqueName: \"kubernetes.io/projected/50fbcccc-e019-40a3-9d93-e03a1867a342-kube-api-access-pbhgs\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.347697 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.347681 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50fbcccc-e019-40a3-9d93-e03a1867a342-tmp\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.361273 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.361246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhgs\" (UniqueName: \"kubernetes.io/projected/50fbcccc-e019-40a3-9d93-e03a1867a342-kube-api-access-pbhgs\") pod \"jobset-operator-5bc45f897-78mtp\" (UID: \"50fbcccc-e019-40a3-9d93-e03a1867a342\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.487463 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.487387 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" Jul 16 03:48:58.609410 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:58.609388 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-78mtp"] Jul 16 03:48:58.611397 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:48:58.611371 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50fbcccc_e019_40a3_9d93_e03a1867a342.slice/crio-ba4ba1e1f9f17c2dd54285e446a5b663411722948619814a2d70cff91b59c01c WatchSource:0}: Error finding container ba4ba1e1f9f17c2dd54285e446a5b663411722948619814a2d70cff91b59c01c: Status 404 returned error can't find the container with id ba4ba1e1f9f17c2dd54285e446a5b663411722948619814a2d70cff91b59c01c Jul 16 03:48:59.422720 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:48:59.422661 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" event={"ID":"50fbcccc-e019-40a3-9d93-e03a1867a342","Type":"ContainerStarted","Data":"ba4ba1e1f9f17c2dd54285e446a5b663411722948619814a2d70cff91b59c01c"} Jul 16 03:49:01.432711 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:49:01.432619 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" event={"ID":"50fbcccc-e019-40a3-9d93-e03a1867a342","Type":"ContainerStarted","Data":"d43ed2e33b5283288bca9d3843d124d891d6cf9221131f67ea66c1e10cf0680a"} Jul 16 03:49:01.452160 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:49:01.452106 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-78mtp" podStartSLOduration=0.904700338 podStartE2EDuration="3.452087004s" totalImagesPullingTime="2.547386666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:49:01.450885265 +0000 UTC m=+279.570430714" watchObservedRunningTime="2026-07-16 03:49:01.452087004 +0000 UTC m=+279.571632433" Jul 16 03:49:22.240349 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:49:22.240304 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 03:51:10.064193 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.064162 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584d4ffc68-whg64"] Jul 16 03:51:10.067214 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.067197 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.079815 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.079788 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584d4ffc68-whg64"] Jul 16 03:51:10.110190 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkssg\" (UniqueName: \"kubernetes.io/projected/9956dd46-9d62-480a-a57e-00eb31ef163a-kube-api-access-dkssg\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110190 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110189 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-console-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110206 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-oauth-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-trusted-ca-bundle\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-oauth-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110422 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-service-ca\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.110579 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.110434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211620 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211588 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-trusted-ca-bundle\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211784 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-oauth-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211784 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-service-ca\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211894 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211894 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkssg\" (UniqueName: \"kubernetes.io/projected/9956dd46-9d62-480a-a57e-00eb31ef163a-kube-api-access-dkssg\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.211894 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-console-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.212049 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.211918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-oauth-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.212517 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.212483 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-service-ca\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.212665 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.212615 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-console-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.212715 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.212657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-oauth-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.212715 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.212689 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9956dd46-9d62-480a-a57e-00eb31ef163a-trusted-ca-bundle\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.214043 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.214020 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-oauth-config\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.214238 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.214218 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9956dd46-9d62-480a-a57e-00eb31ef163a-console-serving-cert\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.220443 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.220423 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkssg\" (UniqueName: \"kubernetes.io/projected/9956dd46-9d62-480a-a57e-00eb31ef163a-kube-api-access-dkssg\") pod \"console-584d4ffc68-whg64\" (UID: \"9956dd46-9d62-480a-a57e-00eb31ef163a\") " pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.376587 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.376498 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:10.503870 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.503847 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584d4ffc68-whg64"] Jul 16 03:51:10.506403 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:51:10.506371 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9956dd46_9d62_480a_a57e_00eb31ef163a.slice/crio-dbbc86fbe92b9a4ae77251c8d432d4ff50c0ed93fa75e9804a46daba923428cf WatchSource:0}: Error finding container dbbc86fbe92b9a4ae77251c8d432d4ff50c0ed93fa75e9804a46daba923428cf: Status 404 returned error can't find the container with id dbbc86fbe92b9a4ae77251c8d432d4ff50c0ed93fa75e9804a46daba923428cf Jul 16 03:51:10.919355 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.919301 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584d4ffc68-whg64" event={"ID":"9956dd46-9d62-480a-a57e-00eb31ef163a","Type":"ContainerStarted","Data":"aeba4db7a66e152c3039da1674503dc90440b1354a3a0a26b29f6e05f64a3d8f"} Jul 16 03:51:10.919556 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.919410 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584d4ffc68-whg64" event={"ID":"9956dd46-9d62-480a-a57e-00eb31ef163a","Type":"ContainerStarted","Data":"dbbc86fbe92b9a4ae77251c8d432d4ff50c0ed93fa75e9804a46daba923428cf"} Jul 16 03:51:10.937134 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:10.937086 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584d4ffc68-whg64" podStartSLOduration=0.937073502 podStartE2EDuration="937.073502ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:51:10.936072911 +0000 UTC m=+409.055618353" watchObservedRunningTime="2026-07-16 03:51:10.937073502 +0000 UTC m=+409.056618928" Jul 16 03:51:20.377486 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:20.377450 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:20.377964 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:20.377512 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:20.382228 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:20.382205 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:20.962298 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:20.962266 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584d4ffc68-whg64" Jul 16 03:51:21.011585 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:21.011553 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:51:46.035045 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.034954 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-98d6ccf4f-v6xd8" podUID="d06df040-a03c-4885-b150-aab222a06434" containerName="console" containerID="cri-o://24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12" gracePeriod=15 Jul 16 03:51:46.274858 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.274832 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:51:46.369740 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369667 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.369740 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369698 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.369740 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369721 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.370006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369758 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.370006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369788 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxc2l\" (UniqueName: \"kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.370006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369817 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.370006 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.369837 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle\") pod \"d06df040-a03c-4885-b150-aab222a06434\" (UID: \"d06df040-a03c-4885-b150-aab222a06434\") " Jul 16 03:51:46.370237 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.370212 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config" (OuterVolumeSpecName: "console-config") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:51:46.370292 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.370099 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca" (OuterVolumeSpecName: "service-ca") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:51:46.370292 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.370279 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:51:46.370402 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.370360 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 03:51:46.371929 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.371904 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l" (OuterVolumeSpecName: "kube-api-access-dxc2l") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "kube-api-access-dxc2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:51:46.372323 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.372304 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:51:46.372389 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.372329 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d06df040-a03c-4885-b150-aab222a06434" (UID: "d06df040-a03c-4885-b150-aab222a06434"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 03:51:46.470447 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470416 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-service-ca\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470447 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470441 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-console-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470447 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470450 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470652 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470457 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d06df040-a03c-4885-b150-aab222a06434-console-oauth-config\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470652 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470467 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxc2l\" (UniqueName: \"kubernetes.io/projected/d06df040-a03c-4885-b150-aab222a06434-kube-api-access-dxc2l\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470652 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470476 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-oauth-serving-cert\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:46.470652 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:46.470484 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d06df040-a03c-4885-b150-aab222a06434-trusted-ca-bundle\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:51:47.060763 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.060728 2583 generic.go:356] "Generic (PLEG): container finished" podID="d06df040-a03c-4885-b150-aab222a06434" containerID="24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12" exitCode=0 Jul 16 03:51:47.061222 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.060780 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98d6ccf4f-v6xd8" Jul 16 03:51:47.061222 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.060830 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98d6ccf4f-v6xd8" event={"ID":"d06df040-a03c-4885-b150-aab222a06434","Type":"ContainerDied","Data":"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12"} Jul 16 03:51:47.061222 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.060895 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98d6ccf4f-v6xd8" event={"ID":"d06df040-a03c-4885-b150-aab222a06434","Type":"ContainerDied","Data":"3afaa618ec920690370446fdd56bbdcfd9384a9c34c98cb5ab3351b23f8f7563"} Jul 16 03:51:47.061222 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.060926 2583 scope.go:117] "RemoveContainer" containerID="24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12" Jul 16 03:51:47.068852 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.068837 2583 scope.go:117] "RemoveContainer" containerID="24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12" Jul 16 03:51:47.069092 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:51:47.069072 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12\": container with ID starting with 24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12 not found: ID does not exist" containerID="24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12" Jul 16 03:51:47.069154 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.069106 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12"} err="failed to get container status \"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12\": rpc error: code = NotFound desc = could not find container \"24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12\": container with ID starting with 24312fad56609c124f22a45040f0afc741b9a863ecccf427ba62c54a67c74f12 not found: ID does not exist" Jul 16 03:51:47.091556 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.091533 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:51:47.095855 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:47.095835 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98d6ccf4f-v6xd8"] Jul 16 03:51:48.328496 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:51:48.328463 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06df040-a03c-4885-b150-aab222a06434" path="/var/lib/kubelet/pods/d06df040-a03c-4885-b150-aab222a06434/volumes" Jul 16 03:52:57.236776 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.236743 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nnstw/must-gather-fhkv4"] Jul 16 03:52:57.237284 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.237000 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06df040-a03c-4885-b150-aab222a06434" containerName="console" Jul 16 03:52:57.237284 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.237011 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06df040-a03c-4885-b150-aab222a06434" containerName="console" Jul 16 03:52:57.237284 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.237062 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06df040-a03c-4885-b150-aab222a06434" containerName="console" Jul 16 03:52:57.243189 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.243157 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.245510 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.245488 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnstw\"/\"kube-root-ca.crt\"" Jul 16 03:52:57.246663 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.246582 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nnstw\"/\"default-dockercfg-cjq79\"" Jul 16 03:52:57.246964 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.246944 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnstw\"/\"openshift-service-ca.crt\"" Jul 16 03:52:57.248373 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.248351 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnstw/must-gather-fhkv4"] Jul 16 03:52:57.283611 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.283578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjzk\" (UniqueName: \"kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.283737 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.283651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.384917 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.384879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shjzk\" (UniqueName: \"kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.385077 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.384942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.385251 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.385236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.392878 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.392853 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjzk\" (UniqueName: \"kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk\") pod \"must-gather-fhkv4\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.553504 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.553418 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:52:57.674459 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.674437 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnstw/must-gather-fhkv4"] Jul 16 03:52:57.676763 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:52:57.676741 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa8a087f_cc3a_43a3_be8e_57e597f002ee.slice/crio-229f7206e75949d7c3be1205b248e6417530a5febf9ea162d82d87c4b4da8887 WatchSource:0}: Error finding container 229f7206e75949d7c3be1205b248e6417530a5febf9ea162d82d87c4b4da8887: Status 404 returned error can't find the container with id 229f7206e75949d7c3be1205b248e6417530a5febf9ea162d82d87c4b4da8887 Jul 16 03:52:57.678678 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:57.678662 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 03:52:58.331434 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:52:58.331393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnstw/must-gather-fhkv4" event={"ID":"aa8a087f-cc3a-43a3-be8e-57e597f002ee","Type":"ContainerStarted","Data":"229f7206e75949d7c3be1205b248e6417530a5febf9ea162d82d87c4b4da8887"} Jul 16 03:53:04.358083 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:04.358044 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnstw/must-gather-fhkv4" event={"ID":"aa8a087f-cc3a-43a3-be8e-57e597f002ee","Type":"ContainerStarted","Data":"310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4"} Jul 16 03:53:04.358521 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:04.358092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnstw/must-gather-fhkv4" event={"ID":"aa8a087f-cc3a-43a3-be8e-57e597f002ee","Type":"ContainerStarted","Data":"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589"} Jul 16 03:53:04.375864 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:04.375805 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nnstw/must-gather-fhkv4" podStartSLOduration=1.34930451 podStartE2EDuration="7.375789077s" totalImagesPullingTime="6.026484567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:53:04.374516672 +0000 UTC m=+522.494062127" watchObservedRunningTime="2026-07-16 03:53:04.375789077 +0000 UTC m=+522.495334505" Jul 16 03:53:49.556488 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:49.556455 2583 generic.go:356] "Generic (PLEG): container finished" podID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerID="d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589" exitCode=0 Jul 16 03:53:49.556488 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:49.556493 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnstw/must-gather-fhkv4" event={"ID":"aa8a087f-cc3a-43a3-be8e-57e597f002ee","Type":"ContainerDied","Data":"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589"} Jul 16 03:53:49.556946 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:49.556797 2583 scope.go:117] "RemoveContainer" containerID="d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589" Jul 16 03:53:49.593079 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:49.593055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nnstw_must-gather-fhkv4_aa8a087f-cc3a-43a3-be8e-57e597f002ee/gather/0.log" Jul 16 03:53:50.086872 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.086840 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58mlw/must-gather-ptp24"] Jul 16 03:53:50.090079 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.090056 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.092923 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.092904 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58mlw\"/\"kube-root-ca.crt\"" Jul 16 03:53:50.093954 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.093937 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-58mlw\"/\"default-dockercfg-2gjv2\"" Jul 16 03:53:50.094045 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.093959 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58mlw\"/\"openshift-service-ca.crt\"" Jul 16 03:53:50.098818 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.098795 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58mlw/must-gather-ptp24"] Jul 16 03:53:50.215437 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.215396 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfc6962d-3245-4760-8f1b-306ffee45445-must-gather-output\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.215437 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.215446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs4zj\" (UniqueName: \"kubernetes.io/projected/cfc6962d-3245-4760-8f1b-306ffee45445-kube-api-access-hs4zj\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.316147 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.316105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfc6962d-3245-4760-8f1b-306ffee45445-must-gather-output\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.316147 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.316152 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs4zj\" (UniqueName: \"kubernetes.io/projected/cfc6962d-3245-4760-8f1b-306ffee45445-kube-api-access-hs4zj\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.316439 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.316422 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cfc6962d-3245-4760-8f1b-306ffee45445-must-gather-output\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.323886 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.323863 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs4zj\" (UniqueName: \"kubernetes.io/projected/cfc6962d-3245-4760-8f1b-306ffee45445-kube-api-access-hs4zj\") pod \"must-gather-ptp24\" (UID: \"cfc6962d-3245-4760-8f1b-306ffee45445\") " pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.399846 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.399820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58mlw/must-gather-ptp24" Jul 16 03:53:50.525706 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.525678 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58mlw/must-gather-ptp24"] Jul 16 03:53:50.527360 ip-10-0-130-168 kubenswrapper[2583]: W0716 03:53:50.527320 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfc6962d_3245_4760_8f1b_306ffee45445.slice/crio-9dccd41f91fd9a8a4b66a275cee3f89ed328fe7239c15d43b120691fcd4e7ae2 WatchSource:0}: Error finding container 9dccd41f91fd9a8a4b66a275cee3f89ed328fe7239c15d43b120691fcd4e7ae2: Status 404 returned error can't find the container with id 9dccd41f91fd9a8a4b66a275cee3f89ed328fe7239c15d43b120691fcd4e7ae2 Jul 16 03:53:50.562592 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:50.562560 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58mlw/must-gather-ptp24" event={"ID":"cfc6962d-3245-4760-8f1b-306ffee45445","Type":"ContainerStarted","Data":"9dccd41f91fd9a8a4b66a275cee3f89ed328fe7239c15d43b120691fcd4e7ae2"} Jul 16 03:53:51.569827 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:51.569740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58mlw/must-gather-ptp24" event={"ID":"cfc6962d-3245-4760-8f1b-306ffee45445","Type":"ContainerStarted","Data":"daee672631a9ef2ef667d33161e3d078293472b3c6a7df89112ba219294f63c4"} Jul 16 03:53:51.569827 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:51.569789 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58mlw/must-gather-ptp24" event={"ID":"cfc6962d-3245-4760-8f1b-306ffee45445","Type":"ContainerStarted","Data":"ed5a7e2d944f17322e5ed39ce60fa0a11f52ab0d4fc83813b46d76f71cc47f49"} Jul 16 03:53:51.587310 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:51.587246 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58mlw/must-gather-ptp24" podStartSLOduration=0.817019459 podStartE2EDuration="1.587224029s" totalImagesPullingTime="770.20457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 03:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:53:51.584930923 +0000 UTC m=+569.704476352" watchObservedRunningTime="2026-07-16 03:53:51.587224029 +0000 UTC m=+569.706769460" Jul 16 03:53:52.671431 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:52.671404 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l7742_e07cf84d-3cfa-49fa-b1f0-13ad9e240ec8/global-pull-secret-syncer/0.log" Jul 16 03:53:52.867709 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:52.867680 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mrhkd_210db13e-eab4-40fa-8749-cc10d87d1fb5/konnectivity-agent/0.log" Jul 16 03:53:52.893995 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:52.893970 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-168.ec2.internal_8c5b7472850cd0aeba254c850e4f4352/haproxy/0.log" Jul 16 03:53:54.924834 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:54.924783 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-nnstw/must-gather-fhkv4"] Jul 16 03:53:54.925587 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:54.925089 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-nnstw/must-gather-fhkv4" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="copy" containerID="cri-o://310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4" gracePeriod=2 Jul 16 03:53:54.928069 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:54.928037 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fhkv4\" is forbidden: User \"system:node:ip-10-0-130-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nnstw\": no relationship found between node 'ip-10-0-130-168.ec2.internal' and this object" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:54.928956 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:54.928932 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-nnstw/must-gather-fhkv4"] Jul 16 03:53:55.321084 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.321049 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nnstw_must-gather-fhkv4_aa8a087f-cc3a-43a3-be8e-57e597f002ee/copy/0.log" Jul 16 03:53:55.325704 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.325456 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:55.328926 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:55.328889 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fhkv4\" is forbidden: User \"system:node:ip-10-0-130-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nnstw\": no relationship found between node 'ip-10-0-130-168.ec2.internal' and this object" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:55.468370 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.468269 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output\") pod \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " Jul 16 03:53:55.468552 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.468384 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjzk\" (UniqueName: \"kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk\") pod \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\" (UID: \"aa8a087f-cc3a-43a3-be8e-57e597f002ee\") " Jul 16 03:53:55.470215 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.469980 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "aa8a087f-cc3a-43a3-be8e-57e597f002ee" (UID: "aa8a087f-cc3a-43a3-be8e-57e597f002ee"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 03:53:55.473638 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.473580 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk" (OuterVolumeSpecName: "kube-api-access-shjzk") pod "aa8a087f-cc3a-43a3-be8e-57e597f002ee" (UID: "aa8a087f-cc3a-43a3-be8e-57e597f002ee"). InnerVolumeSpecName "kube-api-access-shjzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 03:53:55.569072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.569007 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjzk\" (UniqueName: \"kubernetes.io/projected/aa8a087f-cc3a-43a3-be8e-57e597f002ee-kube-api-access-shjzk\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:53:55.569072 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.569043 2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa8a087f-cc3a-43a3-be8e-57e597f002ee-must-gather-output\") on node \"ip-10-0-130-168.ec2.internal\" DevicePath \"\"" Jul 16 03:53:55.600906 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.600873 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nnstw_must-gather-fhkv4_aa8a087f-cc3a-43a3-be8e-57e597f002ee/copy/0.log" Jul 16 03:53:55.601588 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.601555 2583 generic.go:356] "Generic (PLEG): container finished" podID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerID="310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4" exitCode=143 Jul 16 03:53:55.601719 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.601670 2583 scope.go:117] "RemoveContainer" containerID="310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4" Jul 16 03:53:55.601853 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.601834 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:55.627360 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:55.612795 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fhkv4\" is forbidden: User \"system:node:ip-10-0-130-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nnstw\": no relationship found between node 'ip-10-0-130-168.ec2.internal' and this object" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:55.639597 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:55.639559 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fhkv4\" is forbidden: User \"system:node:ip-10-0-130-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nnstw\": no relationship found between node 'ip-10-0-130-168.ec2.internal' and this object" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" pod="openshift-must-gather-nnstw/must-gather-fhkv4" Jul 16 03:53:55.641968 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.641702 2583 scope.go:117] "RemoveContainer" containerID="d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589" Jul 16 03:53:55.667800 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.667383 2583 scope.go:117] "RemoveContainer" containerID="310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4" Jul 16 03:53:55.667800 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:55.667774 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4\": container with ID starting with 310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4 not found: ID does not exist" containerID="310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4" Jul 16 03:53:55.667946 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.667814 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4"} err="failed to get container status \"310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4\": rpc error: code = NotFound desc = could not find container \"310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4\": container with ID starting with 310c452448a1bc18c94227baeef10d075cc99cea6103b96a55d792a880c515c4 not found: ID does not exist" Jul 16 03:53:55.667946 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.667843 2583 scope.go:117] "RemoveContainer" containerID="d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589" Jul 16 03:53:55.669503 ip-10-0-130-168 kubenswrapper[2583]: E0716 03:53:55.668093 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589\": container with ID starting with d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589 not found: ID does not exist" containerID="d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589" Jul 16 03:53:55.669503 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:55.668120 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589"} err="failed to get container status \"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589\": rpc error: code = NotFound desc = could not find container \"d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589\": container with ID starting with d04c323307a8c2943e3c5d8e8cda7b54d82dfb149292ce14e44dbaa754aa2589 not found: ID does not exist" Jul 16 03:53:56.333059 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:56.332972 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" path="/var/lib/kubelet/pods/aa8a087f-cc3a-43a3-be8e-57e597f002ee/volumes" Jul 16 03:53:57.055511 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.055481 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-55bqf_a5d5a5db-0331-481f-997a-a4e1019b1d72/monitoring-plugin/0.log" Jul 16 03:53:57.176620 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.176584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dswrh_45108891-4a6d-4648-9fca-17347347cbdd/node-exporter/0.log" Jul 16 03:53:57.199899 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.199871 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dswrh_45108891-4a6d-4648-9fca-17347347cbdd/kube-rbac-proxy/0.log" Jul 16 03:53:57.223737 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.223709 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dswrh_45108891-4a6d-4648-9fca-17347347cbdd/init-textfile/0.log" Jul 16 03:53:57.610953 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.610921 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-744cd_1ce3f495-f435-4e4b-9f98-42a36bd432a2/prometheus-operator/0.log" Jul 16 03:53:57.632614 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.632587 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-744cd_1ce3f495-f435-4e4b-9f98-42a36bd432a2/kube-rbac-proxy/0.log" Jul 16 03:53:57.657776 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:57.657749 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-zlr52_fff2bfd6-5703-4e97-82b9-419b9036ca00/prometheus-operator-admission-webhook/0.log" Jul 16 03:53:59.970663 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:53:59.970639 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-584d4ffc68-whg64_9956dd46-9d62-480a-a57e-00eb31ef163a/console/0.log" Jul 16 03:54:00.135640 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.135604 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs"] Jul 16 03:54:00.135954 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.135937 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="gather" Jul 16 03:54:00.135954 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.135954 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="gather" Jul 16 03:54:00.136073 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.135975 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="copy" Jul 16 03:54:00.136073 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.135983 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="copy" Jul 16 03:54:00.136173 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.136072 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="gather" Jul 16 03:54:00.136173 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.136086 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8a087f-cc3a-43a3-be8e-57e597f002ee" containerName="copy" Jul 16 03:54:00.140975 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.140950 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.149351 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.149312 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs"] Jul 16 03:54:00.313530 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.313444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-proc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.313530 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.313489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-podres\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.313530 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.313506 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-lib-modules\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.313732 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.313627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-sys\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.313732 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.313657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbrc\" (UniqueName: \"kubernetes.io/projected/1acdb2c9-377e-456a-9365-134c7482f2ae-kube-api-access-zkbrc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414628 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-sys\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414628 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414631 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbrc\" (UniqueName: \"kubernetes.io/projected/1acdb2c9-377e-456a-9365-134c7482f2ae-kube-api-access-zkbrc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-proc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-podres\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-lib-modules\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414730 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-sys\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.414865 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-proc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.415074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414946 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-podres\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.415074 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.414971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1acdb2c9-377e-456a-9365-134c7482f2ae-lib-modules\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.423698 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.423649 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbrc\" (UniqueName: \"kubernetes.io/projected/1acdb2c9-377e-456a-9365-134c7482f2ae-kube-api-access-zkbrc\") pod \"perf-node-gather-daemonset-7q8fs\" (UID: \"1acdb2c9-377e-456a-9365-134c7482f2ae\") " pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.452190 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.452162 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:00.611400 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.611292 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs"] Jul 16 03:54:00.630826 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:00.630772 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" event={"ID":"1acdb2c9-377e-456a-9365-134c7482f2ae","Type":"ContainerStarted","Data":"6c35ec276f7c3a3205a29258b321c8ddd3bb041d8be4fd8d9d9ccfc74b551d97"} Jul 16 03:54:01.476722 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.476694 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rhqzt_d20f6bc8-3cf6-4ad9-85b1-a51699273a26/dns/0.log" Jul 16 03:54:01.498093 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.498070 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rhqzt_d20f6bc8-3cf6-4ad9-85b1-a51699273a26/kube-rbac-proxy/0.log" Jul 16 03:54:01.551776 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.551752 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kg96f_9329d0f0-474e-4793-9372-6c57fb99d016/dns-node-resolver/0.log" Jul 16 03:54:01.638188 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.638150 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" event={"ID":"1acdb2c9-377e-456a-9365-134c7482f2ae","Type":"ContainerStarted","Data":"ebfbdf86b08b48f312aa1b6161ddc73aa6a699ec29ba7503961d5c44a6aa2a17"} Jul 16 03:54:01.639285 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.639257 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:01.657031 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:01.656979 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" podStartSLOduration=1.6569606399999999 podStartE2EDuration="1.65696064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 03:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 03:54:01.655440122 +0000 UTC m=+579.774985571" watchObservedRunningTime="2026-07-16 03:54:01.65696064 +0000 UTC m=+579.776506068" Jul 16 03:54:02.006303 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:02.006273 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49hgq_786267a6-611c-4a46-a834-6c9752f4649b/node-ca/0.log" Jul 16 03:54:03.128102 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:03.128067 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66gx8_d91c5d7b-b9af-41d9-a408-e488dba2d0c4/serve-healthcheck-canary/0.log" Jul 16 03:54:03.639440 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:03.639414 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd9rj_c5680e09-96d8-4144-b374-ef7e690a4429/kube-rbac-proxy/0.log" Jul 16 03:54:03.662306 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:03.662276 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd9rj_c5680e09-96d8-4144-b374-ef7e690a4429/exporter/0.log" Jul 16 03:54:03.683918 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:03.683888 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd9rj_c5680e09-96d8-4144-b374-ef7e690a4429/extractor/0.log" Jul 16 03:54:05.476556 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:05.476513 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-78mtp_50fbcccc-e019-40a3-9d93-e03a1867a342/jobset-operator/0.log" Jul 16 03:54:08.656914 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:08.656052 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-58mlw/perf-node-gather-daemonset-7q8fs" Jul 16 03:54:10.195940 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.195853 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/kube-multus-additional-cni-plugins/0.log" Jul 16 03:54:10.225611 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.225584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/egress-router-binary-copy/0.log" Jul 16 03:54:10.249312 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.249274 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/cni-plugins/0.log" Jul 16 03:54:10.277591 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.277566 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/bond-cni-plugin/0.log" Jul 16 03:54:10.321505 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.321482 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/routeoverride-cni/0.log" Jul 16 03:54:10.350504 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.350465 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/whereabouts-cni-bincopy/0.log" Jul 16 03:54:10.375715 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.375683 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpq5m_9e6bfc25-3809-4c30-8def-6d43d333680f/whereabouts-cni/0.log" Jul 16 03:54:10.657515 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.657468 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fwr2g_c2f85585-aee0-4179-be2e-37fe166023a4/kube-multus/0.log" Jul 16 03:54:10.857887 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.857820 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4nkf_6bfd1426-c9ef-4817-91c7-0a43f4ac3feb/network-metrics-daemon/0.log" Jul 16 03:54:10.884618 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:10.884595 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4nkf_6bfd1426-c9ef-4817-91c7-0a43f4ac3feb/kube-rbac-proxy/0.log" Jul 16 03:54:12.153399 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.153372 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/ovn-controller/0.log" Jul 16 03:54:12.176603 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.176565 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/ovn-acl-logging/0.log" Jul 16 03:54:12.204182 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.204157 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/kube-rbac-proxy-node/0.log" Jul 16 03:54:12.229369 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.229311 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 03:54:12.252542 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.252516 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/northd/0.log" Jul 16 03:54:12.278382 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.278347 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/nbdb/0.log" Jul 16 03:54:12.305348 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.305311 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/sbdb/0.log" Jul 16 03:54:12.348977 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:12.348946 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt7cr_606c7c94-cb4d-440b-bed1-707f09e22592/ovnkube-controller/0.log" Jul 16 03:54:13.440513 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:13.440487 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pnp89_f7e59f04-007d-4330-8b22-03a5a854a984/network-check-target-container/0.log" Jul 16 03:54:14.416708 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:14.416681 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rmsxr_d3ed9de7-db3e-459b-a8e9-b460f6630134/iptables-alerter/0.log" Jul 16 03:54:15.075493 ip-10-0-130-168 kubenswrapper[2583]: I0716 03:54:15.075463 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r6qdx_5c549c2c-3323-47a7-81ed-c2f9d2a3e088/tuned/0.log"